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ABSTBACT 

Described is a project tfhich relates psychclinguistic 
processes (reading anc* listening ccaprehensicn) of handicapped 
children to the training needs of special education teachers through 
the application of Computer-Assisted Teacher Training Sy5tea 
technology in perforaance based teacher educaticn. The first chapter 
discusses pre service special education and presents the nine 
objectives of the project. Chapter 2 r€vi€vs the literature and 
considers implications and conclusions relating to the fclloiring 
topics: interactive teaching behaviors and reading and listening 
comprehension, language strategies of retarded children, reading 
studies involving educable mentally handicapped children, reading 
compreh^sion and organization in the retarded. Chapter J describes 
the mexhpds used in the project observation system, training 
mate/rials, coder training, and coder competencies evaluation; tutor 
b^5::K ground, practicuo objectives and tutoring procedures; and 
te'achinq phases and experimental design). Tie results of the project 
(including 11 tables) are discussed in chapter 4. Chapter 5 
summarizes the project in terms of objectives, perspective, methods, 
data sources, and results, and dravs conclusions about the 
effectiveness of the project. (BD) 
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CHAPTER ONE 
INTROIXJCTION AM) OBJECTIVES 



Introduction 

The present project attempted to related the psycholinguistic processes 
of handicapped children to the training needs of special education teachers 
through the innovative application of CATTS tec-»nology in competency ^bassd 
teacher training. The applicat. on of ex terns i.ve r.esearch and inquir inito 
(a) a psycholinguistic approach zo reaiding r^^d Isr^guag^e :3kills (f vorrcon,, 
Sitko and Gillespie, 1975; GoodmH a itiJXKey ' 96'^ i<pf^-< . 1973; R-^^iiSx mii 
Semmel, 1969; (T)] organizatior ..^ .^li^giun-^^ .i^.^^- ;o^^:-xt- e stxmcsgie^ j 
and disadvantaged children f^.g, BL^inton, is-"^-; ■ S-jnnmel, .J%7; Sitko; 2^' ^^t: 
Sitko anid Semmel, 1972, 1973 ), (c) - pacif i - - :::tiomax rmetetiods to fa^litiate 
readimg by retarded and learning disabled ch ..it i (Gillesp ''^ ^ :d Sitko , 
1974), and Cd) competency^-based teaclhex educi-iti pxovided * ^^ theofeticsil 
framework for the present investigation. Th r Cci-nputer-Aiss: o^tii^d Teacher 
Training System (CATTS), developed by Semmiej anc:; iiis assocx^rt^^s CSeisniel, 
1968, 1972, 1975; Semmel, Sitko et. sJ^, , il9:"5), served rs tine pTime vehicle 
for the discrimination, generation, and evaLuatioa of specific teaching 
strategies in reading comprehension by presert'ice special education traineess - 
Specifically, the project compared the relative effect iveness o£ CAT ^ 
instantaneous and delayed video feedback as contrasted with verbal supervisory 
feedback in the development of specific reading and listening strategies in. 
a structured one-to-one tutorial situation with mildly handicapped children. 



Pxeservice Special Education 

There appears to be general agreement among teacher educators that 
present practices used to prepare teachers of handicapped children must 
definitely be improved Ce.g-, Blatt, 1966; Cruickshank, 1967; Deno, 1975; 
Dunn, 1968: L:^*V '^v' 1971; MacMillan, 1972). At the same xime, recent 
developraer:r:3 in the - Lelds of specie.! ar .1 regular educutiion have posed 
challenges and , aV;?lMe:'^: to teacher tir'J ing prograinis in special education • 
These developmeints ir^rczmde: (a) th£- accountability movement in public 
education (^r: , 1? . Lessinger, .. "1 Morris, 19'^! V ergason, 1973), 
Cb] court decj^j \ "jns nnaitdating against*: tt::e excluiiion z^' \andicapped children 
from public scar::! educational progr-nims (Abeson, 197Z. Ir974, Martin, 1972; 
Ross, DeYom.r, Cohen, 1971], [c) cnissnions raised by* s^pecial education 
efficacy stuidi-s [Dunji, 1968; Kolstce,, 972; Lawrence 5 Winshel, 1973; 
Rubin, Kru5^:i u Balow,, 1973), (d) cc^ur decisions regarding improper 
labeling an^ -iac6n::enr of minority chi- Ixen into self-cc ntained special 
classes (Cmickshank, 1972; Gilhool,. 1973; Weintraub, et_ al_. , 1971), 
(e) programs such as Project PRIME ^Programmed Re-entry into Mainstream 
Education] {F:aufman, Semmel, § Agard, 1973) in the state of Texas, which 
focus on the integration and re-entry or mainstreaming of mildly retarded, 
emotionally disturbed and learning disabled children into regular class- 
room settings CBradfield, et al_., 1975; Hafner, 1972; Schwartz, et al. , 
1972),, and (f) a movement in special education and regular education away 
from program-based toward competency-or performance-based teacher education 
programs and teacher certification patterns (Deno, 1973; Houston 5 Howsam, 
1972; Meyen & Altman, 1973; Rosner, 1972; Schmieder, 1973; Schwartz, £t al , , 
1972; Semmel, Semmel § Morrissey, 1976; Shores, Cegelka § Nelson, 1973. 
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In order to r:eet these challenges, there is a critical need in the field 
for the generation of innovative personnel training models and procedures 
to improve teachers' skills in working with cognitively and affectively 
handicapped children in special and regular class settings. 

The application of computer technology offers one promising approach 
to the generation of innovative teacher training models and procedures. 
In the past decade, educators have participated in the technological 
revolutions provoked by advances in computer development. Most large 
school systems use computers for scheduling, general accounting, grading, 
and other automatic functions which previously demanded the long and 
arduous labor of relatively skilled personnel. In addition, the advent 
of **real-time" systems and shared-time arrangements has brought the capa- 
bilities of rapid analysis and feedback directly into the learning situa- 
tion through programmed instructional techniques and various audio-visual 
approaches. Computer-monitored instructional programs are currently 
attempting to reach large numbers of pupils with fewer numbers of teachers. 
Others seek to individualize instruction for specific children. Indeed, 
computer-assisted instruction (CAI] has already been applied to instructional 
programming of handicapped children in our schools (e.g., Meredith, 1971; 
Stolurow, 1960) and to pre- and inservice teacher training programs 
(Cartwright, Cartwright, 5 Robine, 1972; Noffsinger Daiker, 1973). 
Undoubtedly, as such efforts progress and cost factors are controlled, we 
will be faced with the reality of a technological revolution in 
special education within the coming decade. 

The question which arises is : "Can we presently utilize computer 
technology for preparing teachers to work effectively with handicapped 
children in special jnd/or regular class settings?" To our knowledge, 



little attenpt has been rade to explore ar.d evaluate the potential contribu- 
tion of conputers in clarifying training objectives and improving teacher 
conpetencies in existing teacher education prograris . Hence, there is a 
current need for the exploitation of cor.puter technology in teacher training 
progranis in special education. 

Research and developmental activities directed toward realizing a cost- 
effective Computer-Assisted Teacher Training System (CATTS) for training 
special education personnel have continued at the Center for Innovation in 
Teaching the Handicapped (CITH) , Indiana Uni^'crsity, for the past four years 
under the direction of I. Semmel (1972, 1975). A detailed descrip- 
tion of the prototv-pe CATTS is presented in Semmel, 1975. It is sufficient 
at this point to indicate that CATTS focuses on automated approaches to 
systematic collection, suir.narization, analysis, feedback, storage, and 
retrieval of teacher-pupil interactions. CATTS is conceptualized as a 
closed-loop cybernetic system capable of producing continuous instantaneous 
and/or delayed feedback of relevant teacher-pupil interaction data to a 
teacher trainee in the classroom, so that modification of behavior can be 
realized through regulatory teaching moves in accordance with predetermined 
training objectives. The comprehensive system is designed to produce a 
feasible, cost-effective means of systematic observation, real-time analysis, 
storage, and feedback of specific observa vion-coding data relevant to special 
education classroom teacher-pupil interactions. Immediate auditory and 
visual feedback delivery systems and corresponding data summaries have been 
developed for in^ situ and after-session feedback of relevant teacher-pupil 
variables in practicum teaching environments. In essence, CATTS is a versa- 
tile and comprehensive delivery system vvhich can be applied in many ways 
within the teacher training field. CATTS can be of great assistance in the 
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accoiq)li5hi:ient of training objectives fcr cornpetency- or perfomance-based 
traixiing programs in special education. In our opinion, CATTS represents a 
quantum leap in teacher training in general. 

CATTS is the translation of a heuristic teacher training nodel developed 
by Serssel. According to this model, teacher education is conceptualized as 
a problen in adult learning. The learner is required to generate teaching 

c 

behaviors appropriate to the training situation. Teaching itself may be 
seen as a performance skill which is best learned by practice in a realistic 
setting with accurate feedback about one's performance. Successful acquisi- 
tion of teaching skills is viewed as dependent upon (a) specification of 
•'appropriate'* behaviors, (b) valid and reliable feedback of performance 
during practice or acquisition trials, (c) immediate availability of feed- 
back information, and (d) access to previous performance in training sessions. 

The training model (Figure 1) proposes that, if the goal of the training 
procedure is to produce effective teacher performance, the trainee should 
first learn to discriminate among relevant teaching performances, and then 
generate or produce them. He must then be able to evaluate the appropriate- 
ness of particular teaching performances so that he can use them effectively in 
specific situations. In essence, the process of discrimination is the acqusi- 
tion of knowledge; generation is the skill in use of that knc^wledge; and 
evaluation is the process of evaluating that knowledge and the use of skills 
from that knowledge i^i order to assure desired pupil behaviors. At the same time, 
the trainee should develop and display appropriate professional attitudes 
toward exceptional children. The teaching performance may be seen at three 
levels; i.e., the level of individual behaviors , the level of patterns of 
behavior, or the level of teaching "environments,** which may be seen as 
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Figure 1: A Model for preservice training of teachers 
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clusters of behavior patterns. The model also identifies the setting in 
which the training occurs as a critical variable in teacher education. 
Training may be carried out sequentially in a simulated teaching setting, 
a controlled (laboratory) teaching situation, or in the natural classroom. 
There is some evidence that training in the natural environment may be 
economically unfeasible, and it may be unsuitable for particular training 
purposes because trainers are unable to control the occurrence of events 
necessary for observing or performing. There are also administrative and 
ethical problems in consistently utilizing real classroom time for observa- 
tion and training purposes. Hence, a critical training variable, according 
to this model, is to provide inexperienced trainees with the opportunity 
to teach and receive immediate and focused feedback in a controlled (labora- 
tory) teaching setting about specific aspects of their teaching behaviors. 
At the same time, the model acknowledges the importance and effectiveness of 
in situ practicum experiences with handicapped children for preservice 
trainees . ^ 

The interacting skill components described in the model are operative 
within cognitive/acadismic, affective/management, social, linguistic, motor, 
and other special educational contexts. They vary as a function of the 
particular characteristics and developmental levels of the handicapped 
pupils for whom they are prescribed. Other variables to be considered in 
applying the model include: situational classroom characteristics, motiva- 
tional characteristics, feedback characteristics , non-interactive features 
of teacher behavior including assessment and planning behavior, and nature 
of instructional materials. In translating the training model to CATTS, the' 
major premise is that the more immediate the knowledge of results, or feed- 
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back, the more efficient the discrimination, generation and evaluation of 
relevant teaching behaviors, patterns, and environments. 

The investigation of the cost-effectiveness and efficacy of CATTS in 
areas deemed of critical importance to special educators would be of great 
benefit in determining the feasibility and significance of such systems in 
efficiently preparing personnel in special education. The development of 
specific teaching competencies in the field of reading offers an ideal area 
for investigation into this issue. The maiority of EMR children in special 
and/or regular classrooms reveal weaknesses or deficiencies in reading and/or 
listening comprehension skills (Blanton, Sitko 5 Gillespie, 1975, Gillespie 
§ Johnson, 1974; Cawley, Goodstein, § Burrow, 1972). The significance of 
this deficiency is reflected in the knowledge that reading is a communication 
process and that meaning gain must be seen as its significant outcome. Most . 
teaching competencies in reading, particularly those related to reading compre- 
hension, involve complex patterns or chains of teaching behaviors which hr\ve 
to be systematically developed to achieve trainee competency levels that 
optimize pupil growth. Education investigations must give weight to the 
interrelationship between organisational vehicles Ce,g,, CATTS) and content . 
Ce.g,, linguistic models of comprehension). One of the strengths of the 
current sutdy is that it makes use of current psycholinguistic data concerning 
thought/ language xielationships , thereby insuring the soundness of the content 
to be ;conveyed in the testing of the proposed vehicle. 

Presently, feedback to preseryice trainees in practicum situations 
about their interactive teaching behaviors occurs retrospectively, through 
either subjective verbal summaries from supervisors or delayed simple 
summaries of relatively unsophisticated observational data. However, 
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closer analysis of each of these processes reveals that the trainee often 
derives little information about the specific behaviors (.objectives) deemed 

i 

important by the program. Turthermore , the supervisor often has no systematic 
technique for focusin^^ on those teaching behaviors she/he vconsiders relevant, 
and is often times forced to rely on vague ad hoc impressions. 

Allied with this is the further problem that between supervisory confer- 
ences there is often little communication between supervisor and teacher. 
Thus, if supervisory and/or observation data are to be used in training, they 
cannot be fed back, to a trainee in real time. Knowledge of results can 
therefore have no immediate control or effect , on the classroom environment 
from which the data are drawn. 

On the other hand, the CATTS ,^'ystem holds out good hope of overcoming 
the major drawbacks of prevailing training methods--the lack of continuous 
feedback in real time and the teacher's lack of information about his per- 
formance in relation to the behaviors or patterns calculated to realize the 
educational or instructional goals of the- class. The CATTS system has 
real potential as a delivery system for in^creasing the productivity and 
efficiency of training for critical teaching behaviors and teaching patterns 
in reading instruction because it provides immediate, detailed and focused 
feedback of cognitively oriented teacher-pupil interactions. 

The present study investigated the effectiveness of CATTS in -the 
acquisition of specific reading and listening comprehension teaching skills 
by preservice trainees in special education. This study also researched 
the productivity of the system and its efficiency in modifying" the identified 
teaching behaviors and patterns of teacher trainees; in a tutorial (laboratory) 
classroom setting. Productivity in this study was measured in terms of modifi 
cation of the trainees' interactive teaching behaviors and teaching patterns 
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in desired directions. A direct omparison was made against the prevalent 
supervisory mode of feedback currently employed in special education pre- 
service training programs. 



Objectives 



Main Objectiver; 

1. To determine the effectiveness a omputer -Assisted Teacher 
Training System (CATTS) as contrasted w: rbal supervisory feedback in the 
development of critict-l reading and list., g comprehension teaching strate- 
gies in presen ice special education teacher trainees in a tutorial (labora- 
tory) classroom setting. 

2. To test the effectiveness of reading comprehension instructional 
strategies developed out of a psycholinguistic and cognitive view of the 
language process in use with retarded learners in a special classroom setting. 

• Subohjectives 

1. To adapt CATTS for the training of critical patterns of teacher 
interaction in reading and listening comprehension instruction. 

2. To implement the C\TTS paradigm with teacher trainees at Indiana 
University as a part of their preservice educational program in special 
education. 

3. - To determine the rate of acquisition of critical teaching behaviors^ 
and patterns of behavior with the traditional mode of supervisor verbal feed- 

f 

back. 

4. To determine the rate of acquisition of critical teaching behaviors 
and teaching- patterns with instantaneous visual and delayed video feedback 
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via UviTS, 

6, To compare the relative effectiveness of CATTS instantaneous and 
delayed feedback with supervisor verbal feedback in a laboratory classroom 
practicum setting. 

7, To develop a reliable observation-codinj; instrument for use in 
training pres(>rvice teachers in special education to discriminate among, 
generate and aluate specific teaching behavio^ ; :i patterns related to 
reading and ning comprehension instruction. 
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CHAPTER TWO 
REVIEW OF LITERATURE 



Interactive Teaching Behaviors and Reading and Listening djmprohension 

Although there is general agreement that the learner should be taught 
to interact systematically and in a cognitively hierarchical manner in reading 
and language arts, and it is agreed that the teacher's questioning behavior 
often sets the pattern for the way children respond and anticipate responding 
in readings, Borg, et. al. (1970), Crawford et^. (1975), Gall (1970), 

Gallagher and Aschner (1966), Guszak (1967), Sanders (1972); Zimmerman and 
Bergan C1971), and several other investigators have found that most teachers 
ask predominately cognitive-memory or factual-type questions. 

This finding seems to especially be true in the area of reading and 
listening comprehension, even though it is known that questioning techniques 
are extremely powerful in determining those cognitive operations in which 
pupils engage (e.g., Hillman, 1972; Lynch, ejt. ad., 1973; Sanders, 1966; 
Taba, 1966; Wright § Nuthall, 1970). Hatcher (1971) and Forsyth, et. 
(1971} found that ^questions presented in L^isai readers to enhance rea^ ag 
comprehension are mostly factual in nature. ' Furthermore, there is 
also evidence that teachers of EMR children use a greater percentage of 
factual questions in reading and other instruction than teachers of nonretarded 
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eleIR!.e;^i:tibry ^ -Irer- cr^ahley, Goodstein & Burrow, Vino, A lern f| Medvene, 

1968; '■'^s^^noxiX,..'. ^ :i976; Lynch and Ames, 1971; Minskrff, 1967). Their rartional 
here t :t5 tftfe -^'.mlel of reading which views physically sn:: .;."jr units 
as bci- ^ychc 5 ogi:, ally easier to manage. 

ajr.'.itio K rmaii (1967) has found that teachers arj ^ .■'legible 
and more teachr .rered in discussion with retarded ch isrvr^ cause the 
teacher nay thi that these children are not capable of iii^the:; el think- 
ing skills, she.r.e may ask only factual or low-level cognifiTe t,.. tions, or 
not attempt z\\c us- of high-level cognitive skills sue: dlVt -r. :t thinking 
(Cawle;-, Goodstriln ^ Burrow, 1972). 

There is aa>aitional evidence that in heterogeneou a? ^rc ctr:- groups, 
where much of the teaching is under tlie direct verbal gu.Jmrnae ol the teacher 
the puDils of lesser ability or pupils for whom teachers nav/e IjijKar expecta- 
tions tend^to receive fewer and less helpful opportmitiiis iresipond [Beez, 
1972; Brophy § Good, 1970, 1974; Jackson, 11)-" :.: _ . 1970; Lynch 

f, Ajnes, 1971, 1973; Rist, 1970; Rowe, 1969). Teachers freqiuejitly give less 
able children fewer opportunities to respond, less time to respond, and less 
constructive feedback. Educable mentally retarded children as a group 
seem to need frequent opportunities. Moreover, Wolf, King and Huck (1968) 
found that methods and materials may have the incidental re^^ult of teaching 
the child to accept printed material indiscriminately. Hence , 
teacher behavior has not adjusted to the handicapped child ^5 need for 
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"'.''he kind of patterned behavior, the consistent intenijjent behavior, that 
will help him/her attack new words securely and give hrim/her a sense of how 
to interact with an author *s message--as well as with details. 
Language Strategies of Retarded Children 

Ar. examination of various reviews of the researc i litcratiu'e tn Linguistic 
problems of the mentally retarded (MR) of tlie last decade (e, - ' rnont , 
1066; Denny, 1964; Goulet, 1968; Jordan, 1967; McCartiiy, I9i \ S] 1 1 , IP^S; 
S| i\?en, 196S a, b) reflects the minimal influence of inr^r :\ Jr ' opim-^it. 
iv\ triic fields of linguistics, psycholinguistics , and ''L- :\:?r hc:or- r 

in: - ^nice, little attention has been given to the orp ir-onaiL stratfj/". 
smph .-ed by MR children in j^rocessing language. Rc i rd^lar^^d t t:h' 

language of MR children has traditionally focused oj. ;l performance asp: 
of language behavior, i.e., doi^criptive phonological and semantic aspects of 
the child's speech, and the psychological variables which affect such behavior. 
Researchers have devoted relatively little attention to the study of the 
granunatical or generative aspects of the language system of ::etarde=J children. 
Since the major variables which define retardation (such as subaverage intc-llec 
tual functioning and impairments in adaptive behavior) are so highly corre- 
lated with language behavior, it has hqen found useful to view the problems 
of retarded children in the context of contemporary views emanating from the 
field of psycholinguistics (Semmel , ^967 ; Sitko, 1976; Sitke and Semrael, 1973), 

Several psychological theorists have emphasized the importance of 
organizational processes in learning and memory (Broadbent, 1958; Bruner, 
Goodnow 5 Austin, 1956; Mandler, 1967 a, b; Miller, 1956; Neisser, . 1967; 
Tulving, 1962). From the standpoint of information theory, investigators 
have stressed the limited capacity' of the human information-processing system. 
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and the importance of subjecrrivc organization av recording 'of stimulus input 



in maximizing the amount of rexei'ant informal- 



' -lat one 13 a-jie to receive, 



process, and remember, Curren: 



child n 



active learner whD possesses a r< oertc 



. ' zonal [ . "Qce^?"^ 565 fi on, 



which he must select those ;r.*5r;' 



In fact, Spitz (1966, 1977 ^ u ^Ui - r - , r ^ .n :ng ;:c--foi 



or grcajpdng of the material to ne lear— d. tr.w'M;?r, Spr^z r.TiireL: C-Mrr rr^e 
vfjestion is not whether retarded indiv dual '^-^^:\ize nnr er-i - " s, but v<;hat 
manner, under what conditions, anc hove effi' :. K 

Semrael (1967, 1969) hypothesized a fi ;nd -nrnr different in the cr^.ani- 
zational strategies used by EMR a.nd nonret.^ri : -d c ildrc: in ; * 3.ng linguist: 

information. According to this view, £MR cj. Ulrrr ^ac vTimavi-ly "sequential- 
associative'' strategies in dev umng and encoaxng verbal materlTils, while 
"hierarchicar* and '^sequential -assc ciativ- ' .strategies seem be synichronized 
in nonretarded children. Of the tvvo, seqLrt3nti:zl -associative ^strategies are 
relatively more primitive. They develop as the child directly experiences 
associations between linguistic units in his language environment, and they 
are nongenerative , Hierarchical grammatical and semantic strategies are mor^e 
abstract, frequently taking the form of rules governing the permissible rela- 
tionships between linguistic units. Because the generality of such strategies 
makes them more powerful tools for generating and processing 1 mguage, the/ 
are probably related to more proficient language behavior than are sequential- 
associative strategies, r 

Semmel and his associates contep.ded that their studies, in addition t 



mance of MR children may be 
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providing eviosr' f^- qualitative u i:ri)rence between the organizational 
strategies # onretarded cniiJrcn, suggested t \at ENIR children 

probabl;' miytfc tthi^ rip; istic competer to recode 1 irunuiLTtic units or bits 
of informfi?iLi n ji-Tp? ti fricient hierar: classes or categories through the 

use of ab5t-:*a::t niL?^ Unlike nonret: ^rried children who naturally tend to 
avail themselves of 1 ir> competency invoking efficient rules in verbal 
learning situations, MR children J. he propensity to use rules in verbal 
learning contexts. T a retarded cli more sensitive to simple associative 

cues for org/'ni-ing linguistic unit:, -risn to higher-order organizational cues 
in processin. Vrr-::.: stimuli. In 1: - i^>^ic terms, Senvmel (1967) suggested 
that : 

Perhaps the retarded child oper::^:es primarily on the surface 
structure of the Irriguage and derives relatively little from 
the base structun-tMof linguistic constructions. He is, there- 
fore^, relatively imnre dependent on the frequency of occurrence 
of linguistic forns and patterns as he experienctes them in his 
natural language enrvironment (p. 45). 

However, these children probably can develop and use efficient strategies 

when environmental cues for their use are made distinctive. Using a 

variety of verbal learning paradigms, considerable evidence for this 

position was presented by Semmel and his associates CAgard, 1971; Herzog, 

1968; Semmel, 1967, 1969 j Semmel, Barritt 5 Bennett, 1970; Semmel § Bennett, 

.1970; Sitko, 1970; Sitko and Semmel, 1972). These studies were comprehensively 

reviewed elsewhere (Sitko § Semmel, 1973), 

Numerous other studies using a variety of learning and memory paradigms 

have supported the view that retarded children, in contrast to nonretarded 

children, demonstrate inefficiencies in the organization, grouping and/or 

retrieval of linguistically presented information (e.g., Butterfield 5 Belmont, 
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1972; Cawley, Goodstein 5 Burrow, 1972; Cobb 5 Barnard, 1971; Ellis, 1970; 
Gallagher, 1969; Gerjuoy 5 Spitz, 1966; Goodstein, 1970; Gruen 5 Korte, 1973; 
Jensen, 1970; Martin, 1967; Milgram, 1971; Riegel 5 Taylor, 1974; Sitko, 1976; 
Smith, 1967; Vitelio, 1973). In addition, several investigations have 
examined the efficacy of training EMR children to use specific verbal learning 
strategies to facilitate the acquisition and retention or verbal material, and 
they have revealed significant positive results CBlanton, 1974; Gerjuoy § Alvare 
1969; Martin, 1967; Ross, 1971; Ross, Ross a Downing, 1973; Vitelio, 1973; 
Turnbull, 1974; »/hitely § Taylor, 1973). 

Considerable evidence in support of the assumption that EMR children 
probably have the ability to recede or organize linguistic units into 
hierarchical components when prompted was provided in an investigation by 
Sitko and Semmel (1972). The authors studied the effects of phrasal cueing 
on the free recall of EMR and nonretarded children. ' Free recall and coding 
of sentences is most representative of information processing in the class- 
room {e.g., reading comprehension, mathematical problem-solving, concept 
formation). The study was based on the pre^nise that retarded children 
probably have the competence, when prompted, to recede linguistic units into 
hierarchical components. Retarded children appear to process linguistic 
strings as though guided by a Markovian model rather than by a transformational- 
generative model Ccf. McNeill, 1970; Menyuk, 1971; Olson, 1970). Nevertheless, 
the omission of completely novel utterances from EMR children in natural 
language situations suggests that their language behavior is rule-governed. 
Hence, it was assumed that EMR children possess the competence for "learning" 
hierarchical organizational skills in verbal learning situations • Based on 
this preniise, it was reasoned that if the language of the retarded child is 
governed by the same .rules as is the language of his nonretarded peers, then 



18 

making phrase boundaries distinctive through pausal cues should cue chunking 
strategies and increase recall of sentences by FMR children. 

EMR and nonrctardcd children were presented with four types of nine - 
word strings which differed in the degree of syntactic and associative 
structure. Rach subject was presented with one of three cueing conditions. 
The findings indicated that l-MR children revcalcu their best recall perfor- 
mance relative to nonretardcd childrer. when pausal cues (.5 sec. pauses) 
were provided at phrase boundaries within sentences contyfiining standard 
syntax. Recall of EMR children was relatively inferior when subjects were 
nor provided with these cues but were required to impose a structure in 
receding verbal strings which conformed to standard syntactic rules. The 
nonretarded group also exceeded retarded children in recall when given 
sentences with distorted systactic structure and phrasal cueing. The 
results of the cueing study emphasized the impoitance of phrasal cueing 
within the context of standard syntax on the free recall of sentences among 
retarded children. It was inferred from the findings that it may be pos- 
sible to improve the storage and retrieval abilities of retarded children 
through the development of specific pedogogical cueing systems which are 
representative of meaning storage units projected in training models of 
language. 

Reading Studies Involving HMR Children 

. Since evidence exists that, under research conditions which tend to 
highlight isolated word units, retarded and nonretarded children use 
different organizational strategies for processing verbal input, one might 
expect that knowledge of memory and organizational processes would have 
been applied to chiiJren's reaJini; behavior and subsequent comprehension 

1 
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of written material. Unfortunately, this has not been the case for either 
retarded or nonretarded children. In fact, the' literature on reading coin- 
prehension has revealed that attempts to organize and synthesize the infor- 
mation concerning reading comprehension have in general made few references 
to memory and organizational processes (Ruddell, 1968; Smith, 1960; Strang, 
1965). It should be noted, however, that several writers have casually 
referred to memory processes in reading comprehension. Spache (1966) 
and Barrett (quoted by Clymer, 1968), for example, have included memory as 
one dimension of reading comprehension in their taxonomies of reading 
behavior. Although some writers liave made reference to memory in reading 
comprehension, few have made an attempt to operationalize and examine 
empirically the relationship and functioning of memory and organizational 
processes in the comprehension of written connected discourse. 

The lack of such information is unfortunate since one of the most 
persistent problems in the education of retarded children is that of 
effective reading instruction, particularly reading comprehension (Gillespie 
5 Johnson, 1974), Unfortunately, most programs for EMR children have 
been unsuccessful in their attempt to train children to read at levels 
commensurate with their ability. Achievement studies have revealed- signifi- 
cant differences between retarded and nonretarded children in reading per- 
formance (Blake, Aaron, Westbrook, 1967; Bliesmer, 1954; Dunn, 1956; * 
Levitt, 1972; Shotick, 1960). In his review of research in education of 
the MR, Kirk (1964) reported a general finding which is all-too-familiar 
to teachers of EMR children. The research had indicated that MR children 
in special classes read below their "mental-age-reading-grade expectancy," 
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This finding is especially frustrating to teachers of EMR children, who tend 
to predicate their expectations of reading success on the child's M\ level. 
After reviewing several studies of the reading performance of E*^IR children, 
Spiclcer and Bartel (1968) concluded that there was no one characteristic of 
BIR children which could account for all reading difficulties. As a result, 
it was not possible to prescribe a reading method that was effective with 
most EMR children. Cegelka and Cegelka (1970) reported similar findings in 
their review. 

A comprehensive study by Woodcock and Dunn (1967) compared six approaches 
of teaching reading to EMR children. The types of experimental method 
studies included (a) language experience, basal reader, and programmed text 
approach using traditional orthography, (b) a programmed text and language 
experience approach using ^ t_ a (initial teaching alphabet), and (c) a basal 
reader approach using rebus symbols. Tlie sample used for this study consisted 
of ENIRs who were at the earliest stages of beginning reading or had not yet 
learned to read. 'Unless they voiced objections, volunteer teachers were 
randomly assigned to one of the six reading approaches. At the e.id of two 
years the results of the Woodcock and Dunn study indicated no significant 
differences between groups receiving the six treatments on seven measures of' 
reading ability. 

Another study which compared different reading approaches with mildly 
retarded children was an investigation by Dunn and Mueller (1966). These 
researchers investigated the efficacy of (a) a in teaching beginning reading, 
and (b) the Peabody Language Development Kit in stimulating oral language and 
verbal intelligence with a group of disadvantaged first grade children. Briefly, 
the results relating only to the use of ^1 a after one year showed that a 



group of children receiving i^ t_ £ performed significantly better on a reading 
achievement measure than groups using a Lasal reader approach. Likewise, 
results from the second year of the study (Dunn, Pochanart, § Pfost, 1967) 
were similar. An intriguing aspect of this study is that the teachers involved 
in teaching the experimental groups were provided with incentives (extra pay, 
etc.) not provided to control teachers. From this, it can be concluded that 
results may have been caused by the Hawthorne Effect. In order to control 
for this effect, Dunn, Neville, et^ al_. (1967) attempted to determine if i. £ £ 
instructed groups of disadvantaged children would perform significantly better 
than control groups ':^en teachers in all groups were provided with extra 
support and incentives. In addition to i^ t_ the effectiveness of two other 
reading approaches was examined — Words in Color (WIC) and a Supplemental 
Conventional Reading Program (SCRP) . Results after one year of this three-year 
study revealed no differences between the total experimental reading groups 
and the control group on a measure of school achievement. However, the SCRP 
treatment group tended to score higher than the other two reading treatments. 

A recent study by Neville and Vandever (1973) sought to determine 
whether synthetic or analytic reading instruction would facilitate learning 
and transfer of words for mentally retarded children. This investigation 
appears to be the first to examine the differential effects of the two 
methods on transfer using retarded S^s . Briefly, results revealed that (a) 
both retarded and NR children recognized significantly more words when the 
synthetic method was used, ,(b) both groups performed significantly better 
when the synthetic method was used for words taught and for transfer 
words, and (c) no differences were found in the learning and transfer of 
MA-matched retarded and nonretarded groups. These findings would suggest 
that the synthetic method, by emphasizing letters and the way they can be 
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combined to form words, encouraged the children to develop a strategy that 
was useful in decoding new words. 

Programmed Instruction and the use of teaching machines have received 
attention as techniques for teaching reading to the mentally retarded. 
Numerous studies (e. g., Blackman 5 Capobianco, 1965; Price, 1963) have com- 
pared programmed instruction to traditional classroom methods with educable 
retarded children. Gieene's (1966) comprehensive review of the effectiveness 
of such techniques indicated that when these comparisons were made there 
were essentially no achievement differences between the two methods in 
the majority of studies. 

Unfortunately, reviews of the literature and studies which have com- 
pared different methods and approaches for teaching reading to retarded 
children have. provided very littlt definitive evidence in support of one 
method over another. Perhaps many of these studies have placed too much 
concern on the search for a methodological panacea without giving necessary 
consideration to individual abilities and disabilities of specific learners^ 
or of the parameters of the language process. Further, most methodological 
studies with retarded £s have made comparisons among methods which place 
emphasis on the word as the basic unit of reading. Goodman (1969), however, 
has called for a shifting of the focus from words to the comprehension 
strategies of the reader. Words', Goodman has contended, should always be 
viewed as units of larger, meaningful units. This approach, therefore, 
focuses the learner's attention on segmental units, i.e., clauses which 
are based on the semantic and associative features of language. Such a 
model could explain the effectiveness of the pause, used in the Sitko 5 Semmel 
1972, research. 
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The child's ability to process and organize linguistic information 
may be strongly related to the nature of the reading process. One of the 
earliest expositions of a language-based approach to reading instruction 
was by Lefevre (1964). He emphasized the importance of the sentence as a 
meaning-^bearing unit and suggested that in the teaching of reading, words 
should be regarded as a minor linguictic unit, while the importance of 
intonation and stress patterns, and of clauses and sentences should be emphasized. 
Using a cognitive framework, Neisser (1967) described reading as externally 
guided thought in which the stimulus, rather than determining perception, 
serves as a prompter for an ongoing language process. Similarly Kohlers 
(1968) hypothesizes two aspects in the perceptual identification of items: 
initial schematization and subsequent impletion or filling-in. 

Goodman's (1969) hypothesis-testing view of the reading process 
mentioned above assumes that the ultimate goal of reading is direct passage 
from print to meaning, without going through surface speech processes. in 
between. According to Goodman (1972), reading is a psycholinguistic guessing 
game which, uses language cues selected from perceptual input. In order for 
the child to engage in the reading process, he/she must be able to possess 
language information that is encoded in graphic symbols (Goodman, 1968). 

Goodman (1965, 1968, 1969, 1972) has designated "cues'' or "cue systems" 
that must be used by the reader in obtaining meaning from written language. 
He considers "miscues" in oral reading to be very important to the teacher 
because they provide information about the child's language skills. Cues 
may be based upon (a) clues within words, (b) the flow of the language in 
terms of operations such as function order, inflection or inflectional 
agreement, intonation or reference to what comes prior to or after the word 
in question, and (c) cues external to the language and the reader such as 
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his/her dialect, experimental and family background (Goodip.an, 1968) . If 
error analysis of a child's reading ;Tiiscues is qualitative rather than 
quantitative, the teacher will be able to use oral reading as a means of 
assessing the language strategies a child employs while engaged in the 
reading process. The Reading Miscue Inventory developed by Burke and 
Y. Goodman (1972) is one source for a qualitative analysis of a child's 
miscues and could serve as a framework for the study of a retarded child's 
cueing systems. 

In summarizing the various models for reading based on the active 
participation of the reader, Ryan and Semmel (1969) have shown that con- 
siderable evidence exists that reading is a cue sampling process, rather 
than one requiring absolute discrimination of detail. Tliey conclude that 
children's reiding material should be written to maximize the child's 
opportunity to develop efficient habits of forming and testing hypotheses. 
Moreover, the beginning or retarded reader should be encouraged by the 
teacher to apply appropriate high-order language strategies--such strategies 
are already available from oral language usage. Emphasis should be focused 
on "conceptual" aspects of reading rather than on "perceptual" aspects and 
relations, or on single words. 

The views of Ryan and Semmel (1969) were incorporated into the rationale 
of a study conducted by Sitko, et_ al^. (1&/2) which sought to lay the ground- 
word for a psycholinguistically-based reading program. Specifically, the 
study attempted to (a) establish word-association (W«A) norms for a group 
of EMR children and (b) empirically examine the effects of the children's 
word associations on reading performance. Such a study, it was expected, 
would lead to the development of methods for practical utilization of. norms 
in the writing of reading materials for ENIR children. Results indicated 
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that a free W-A task with a group of young BIR children did reveal 
comnonality of associational responses. This connnonality o£ associational 
responses also existed for responses to sequentially constrained stimuli 
within a sentence, but did not exist for EMR pupils* sequential resporses 
to stimulus sentences. No support was found for the efficacy of using 
high-association word pairs in sight vocabulary lessons for primary U\R 
children. 

It was noted that all the teachers in the study used some variation 
of a basic phonic analysis approach to teaching reading. This approach 
takes the word as the basic unit of reading and does not attend to the 
relevance of linguistic context Cseman^ic and syntactic relationships) in 
deternjining word perception and comprehension. The authors concluded that 
in order for associative proclivities of handicapped learners to be useful 
in enhancing their acquisition of reading skills, the learners must develop 
a set or be taught to attend to the associative (semantic] properties or 
features of word pairs and the associative constraints implicit in high- 
association sentences. The authors stressed the need to develop various 
activities and games that encourage retarded readers to attend to and use 
relevant linguistic organizational strategies which take advantage of the 
,.familiar structure of reading materials. Much of the reading instruction 
with retarded children has not been based Upon language structure but rather 
upon graphic features of the language. The Sitko et_ al_. investigation was 
a positive step toward developing such reading instruction. 

In summary, the reading methodology studies presented offer little 
evidence to support the use of one method oyer another where both methods 

reflect either the same model of reading or reflect models which isolate^ 

/ 
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and stress selected features with retarded children. Perhaps the most 
exciting developments, however, are these which emphasize reading instruction 
based upon knowledge of ps>'cholinguist ics . 
Reading Comprehension and Organization in the Retarded 

As stated previously, reading researchers have only alluded to the 
possible relationship between organizational processes and reading behavior. 
In fact, a review of the literature on reading has revealed a paucity of 
research dealing with organisational processes and reading in retarded children. 
Three recent and important investigations by Bilsky and Evans (1970), Evans 
(1970) and Blanton (1974), on the other hand, have explored the possibility that the 
difficulty of retarded children in reading comprehension may be the result of 
a basic inability to organize verbal input for storage and retrieval during 
the act of reading. Bilsky and Evans (1970) sought to determine whether the 
ability to organize verbal material is central to the attainment of such 
reading skills as comprehension. Institutionalized retarded subjects with CAs 
between 12 and 19 and IQs ranging from 45 to 70 were used as subjects.. All Ss 
v/ere divided into good and poor reading groups on the basis of reading 
comprehension scores. Each subject was presented a 20-word free recall task 
composed of five words from each of four conceptual categories. Analysis 
of data revealed that subjects in the good reading comprehension group 
clustered significantly more during free recall than subjects in the poor 
reading comprehension group. 

Evans (1970) studied the effects of reading level and mode of pre- 
sentation on category clustering and recall performance of retarded subjects. 
Ss for the investigation were 50 retarded ^'adolescents'' (CA 15.11-22.2) 
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from high schools in a public school systen. The £5 were randomly assigned 
to one o£ three experiizental conditions, that is, node of stimulus pre- 
sentation. There were two uniriodal (a visual and an auditory) presentation 
conditions and a bimodal (visual plus auditory) stimulus presentation. 
Each subject was presented a 20-word free recall list composed of words 
from four conceptual categories. Following the completion of the free 
recall task, all S^s were divided into above- and below-median subgroups 
on the basis of overall reading grade level scores. 

In contrast to the results of Bilsky and Evans (1970), the results 
of the Evans study revealed that clustering performance was not a function 
of general reading ability. The bimodal presentation was found to have 
a significantly greater facilitating effect on recall than the other two 
presentations. It did not have, however, a significant effect on clustering 
performance. The overall correlation coefficient between performance and 
clustering was found to be statistically significant. 

The purpose of an extensive investigation by Blanton (1974) was to 
study the relationship of organizational abilities to the comprehension 
of written and orally presented connected discourse in EMR and nonr^tarded 
children. Subjects for the study were 40 EMR children and 40 children 
with chronological ages between 9 and 12 years. In order to obtain a 
measuj-re of subjective organization (SO), each S_ was individually adminis- 
tered 12 successive free recall learning trials on a 12-word stimulus list. 
Upon completion of the free recall task, the following reading and listening 
comprehension measures were randomly administered: (a) a traditional, 
standardized measure of reading comprehension, (b) a traditional reading 
comprehension measure with reading reinforced by listening, (c) a cloze 
test, and (d) two measures of listening comprehension as measured by 
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verbatin recall across three paragraph conditions. The three paragraph, 
or treatment, conditions differed as to the chunking or organizational 
patterns provided: (a) no cueing within the text of the passage, (h) dis- 
tinctive pausal cueing at phrase boundaries within the text of the passage, 
and (c) distorted pausal cueing at phrase boundaries within the text of 
the passage. 

The results supported six of the seven predictions made in the investi- 
gaion. NR Ss scored significantly higher than BIR Ss on the five measures 
of reading and listening comprehension. As predicted, ENIR children obtained 
significantly higher recall scores on a distinctive phrasal cueing con- 
dition than either a no cueing or a distorted phrasal cueing condition, 
NR Ss received significantly higher scores on a no cueing condition than 
a distorted phrasal cueing condition, and on a distinctive phrasal cueing 
than a distorted phrasal cueing condition. Results revealed that the 
variation between the differences obtained for ENIR S^s and NR S^s on a 
distinctive phrasal cueing paragraph and the differences obtained for EMR 
Ss and NR Ss on a no cueing paragraph were significant for one recall 
measure, but not for the other recall measure. EMR Hi^h Subjective Or- 
ganizers and EMR Low Subjective Organizers did not obtain significantly 
different scores on three measures of reading and listening comprehension. 
Product -moment correlations involving subject variables showed that 
SO was moderately related to verbatim recall measures for the NR group, 
but was not related for the EMR group; SO was related to recall performance 
for NR £s but not for EMR Ss. 

One of the major conclusions of the investigation was that EMR children 
do possess the competence necessary for recoding certain types of information 
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when environmental cues are provided which facilitate the use of higher- 
order organizational abilities. 
Implications 

If teachers are to better meet the needs of retarded children in 
reading and listening comprehension, teacher training programs in special 
education should address themselves to this issue. In order to carry 
out interactive teaching activities in reading and .stening comprehension 
based on the views presented above with retarded children, there is a 
critical need to train teachers in special education to be able to 
perform the following tasks; 

1. Inform pupils of the nature of a reading or listening comprehension 
task, orient pupils to relevant information and cues, provide orienting 
concepts (advance organizers), set forth steps and procedural rules, 
and prepare pupils for useful forms of feecuDack in the v ?5tructional 
situation. Specific activities to be carriied our by the teacher would 
include: 

a. Communicating clearly individualized instructions, procedures, 
and learning objectives to zhe handicapped child before reading 
instruction b^.^gins (i.e., reduce cognitive load o^n short-term 
memory) . 

b. Improving storage of information by insuring that the handicapped 
child understands detailed steps and relationships concerning the 
nature of the reading comprehension task or objectives. 

c. Providing organizing and recoding cues in advance of reading 
instruction to help the handicapped child establish a preparatory 
set for attending selectively to the lesson (e.g., by providing 
spatially-cued verbal outlines of a story; asking organizing 
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questions; guiding the child to look tor particular points or 
attributes of films, bocks, pictures, etc.}. 

d. Attracting and holding attention of handicapped child through 
focusing (verbal and gestural) and pausing procedures which 
orient the child to the particular learning task at hand. 

e. Reducing irrelevant, distracting, and/or ambiguous information 
in introducing reading materials and lessons for handicapped 
children. 

f. Developing ability to scan a group of pupils, while presenting 
reading material orally, in order to identify behavioral cues indicative 
of ^natreT}T an and baf f lemie-' . , . 

2. UtiLize apT^rcr riate high- an:: low-level questioning techniques in 
order to systemar^-ally develop abstract concepts, principles (rules) 
and indtuctive reasoning in hanidicapped children. Specifically, 
acti^'itdes to be carried out wioirld include: 

a. Introduci:ng concept training in reading materials with highly 
fanniliar .and meaningful material (i.e., which includes perceptual 
and associative verbal cues) so that the handicapped learner 
will have some recoding skills available and will achieve a 
sense of mastery. 

b. Using questioning procedures to encourage pupils during a 
concept-oriented reading lesson to talk about familiar experi- 
ences and ideas that provide advance organizers for new concepts 
and new cognitive manipulation. This will be accomplished by 
supporting initial pupil organization of reading information by 
providing for an uninterrupted oral retelling before the use of 
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questioning procedures on specific conponents. 

c. Using ques^'ioning procedures in reading coziprehension lessons 
to stinulate and elicit elaborative pupil verbal expressions of 
personal feelings, beliefs, ideas and experiences as an end in 
itself. 

d. Shaping and eliciting hierarchical classification and cate- 
gorization skills in handicapped children during reading compre- 
hension lessons through specific low-level and high-level 
questioning patterns. 

e. Utilizing inductive questions during classroom reading dialogue 
to strengthen, encourage and guide active hypothesis testing ind 
discovery procedures in handicapped children, 

f. Asking appropriate redirecting, clarifying^ ^nd ;justifyiTig 
questions and eliciting statements of handicapped children during 
reading comprehension lessons, 

g. Using high and low-level questioning techniques to modulate 
or shift the cognitive level of discourse during reading com- 
prehension lessons (e.g., factual, conceptual, theoretical), 

h. Rephrasing and restructuring elicitation when pupil does not 
respond or responds inappropriately during comprehension tasks. 

3. Arrange component subtasks of reading and listening comprehension 
lessons into a learning hierarchy^ ^nd identify efficient teaching patterns 
for developing comprehension skills in poor readers. Specifically, 
activities to be carried out would include: 

a Analyzing and correctly identifying the cognitive demands (skills 
and processes) involved in listening and reading comprehension 

lessons (?.g., Gillespie § Johnson, 1974). 

\ 
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b. Minimizing both the total niinber of ''chunks" of infomation 
as well as the nunber of "bits per chunk*' of infomation in 
oral and written language comprehension tasks. This involves ' 
reducing irrelevant, distracting, and/or ambiguous information 
in comprehension lessons for handicapped children. 

c. Providing handicapped children with ''pausal** and '*intonational" 
cues which stimulate information recoding or "chunking*' during 
discourse learning. 

d. Including summarization, rehearsal, and review procedures as 
an integral part of language comprehension lessons - 

e. Framing oral questions, based on written or oral discourse, 
which reduce the relative effects of forgetting due to inter- 
ference (proactive or retroactive) or competing information 
and memory decay. 

f. If possible, using inductive questions which ask for clari- 
fication of thought and lead the handicapped child into a 

new awareness or concept. 
4. If teachers are to engage in the process of developing teaching 
strategies based on the child's oral reading measures, they must be 
competent in the following skills: 

a. Analysis of reading materials according to level, organi- 
zation, and content. 

b. Utilization of graphs in recording pupil data. 

c. Establishment of patterns of strengths and weaknesses in a 
child's reading strategies. 

d. Analysis of a specific child'. s language patterns (e.g,, dialect). 

e. Analysis of language according to syntax, lexicon, intonation, 
Q and morphology f Burke & Goodman, 1972). 

ERIC 3d 
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f- Categorizing of miscues according to Burke and Goodoan (1972] • 
g. PrograiEning teaching strategies to enhance reading strategies 
of the child. 

The evidence from studies discussed previously indicated that EMR children 
do possess the competence to recode linguistic units into hierarchical 
components when supported by strong environmental cues. Considering the 
important role of organizational abilities in learning and memory, it seems 
logical to suggest the modification of relatively inefficient sequential- 
associative organizational strategies in EMR children to the more hierarchical 
rule-governed strategies. Such a modification in organizational strategies 
should result in greater academic success for EMR children, particularly 
in more rule-governed strategies. Such a modification in organizational 
strategies should result in greater academic succes s for EMR children, . 
particularly in the comprehension of verbal material. If BIR children 
store information inefficiently, then the relationships between words in 
storage are primitive and, as a result, it would be difficult for EMR 
children to retrieve information. By encouraging retarded child' to 
impose organization on linguistic input, their dependence on rote m^ory 
capacity and subsequent ability to comprehend verbal material. 
Conclusions 

As indicated by the review of literature presented in this project 
report, the language and reading comprehension skills of the handicapped 
have been of concern to many investigators in the field of special 
education. The processes involved in the acquisition of language and reading 
strategies with many mildly handicapped children have been demonstrated 
by the literature, and by the present investigators' empirical research, to 
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b^e deficient and to reflect primitive and inefficient levels of cognitive 
and linguistic processing. Moreover, it has been found that teacher b' lavior 
and curricular materials have influopced the psycholinguistic strategies that 
handicapped and normal children employ in language and reading comprehension. 
In the area of reading, teacher behavior has not adjusted to the mildly 
handicapped child's need for the kind of patterned behavior, the consistent 
intelligent behavior , that will help him/her attack new words securely and 
give him/her a sense of how to interact with an author'i> message -- as well 
as with details. It is important for teachers working with handicapped children 
to be aware of the cognitive demands and processes required of the learner 
during reading and listening comprehension. If teachers are to be more 
effective in enhancing the language skills of handicapped children, training 
programs should address themselves to training teachers of the handicapped 
to discriminate, generate, and evaluate their teaching behaviors, patterns 
and environments in language arts instruction. The present project will attempt 
to demonstrate the effectiveness of Computer -As sis ted Teacher Training System 
(CATTS) in training special education pre service teachers to discriminate, 
generate and evaluate appropriate teacher questioning strategies for use in 
reading instruction with handicapped pupils. More specifically, the efficacy 
of CATTS in teaching preservice trainees to use high and low-level questioning 
be^haviors to modulate or shift the cognitive level of discourse and to stimulate 
appropriate hierarchical pupil responses during reading and/or listening com- 
prehension wil-1 be investigated. 



CHAPTER THREE 
METHODS 



Since the present project combined aspects of both an experimerttal study 
and that of a proservice special education practicum course, coordination of 
a number of distinct operations were required. Table 1 illustrates the time 
line for de/elopment and operation activities of each of the major aspects 
of the project. The project built on previous developmental work involving , 
the CATTS system is described in other sections of this report. 
I. Development of Observation System, Training Materials, Coder Training 
and Evaluation of Coder Competencies 

The category observation system used for measurement and feedback of 
teacher and pupil cognitive interactions during reading instruction was the 
Teacher-Pupil Question Response System (TPQR) developed by Sitko atid Heshusius 
(1975)/ The TQRS was a revised version of an earlier system, i.e., the Pupil 
Cognitive-kesponse System (JPCRS) developed by Sitko and Markowitz (1975) . 
The TPQR is described in detail in Appendix F of this section, A list of the 
categories appears in Table 2. The newer version of the TPQR category- 
obsexvation-coding system was designed to increase question appropriateness 
and response-to-question success rate of mildly hi:ndicapped pupils. The ^ 
instrument sequentially measures hierarchical teacher cognitive demands as 
depicted in six types of teacher questions: (1) Discrimination; (2) Recall; 
(3) Sequencing/Paraphrasing; (4) Hierarchically Relating; (5) Inference and; 
(6) Problem Solving. The system also measures pupil responses to teacher 
questions, teacher responses to pupil questions, pupil questions, teacher 
and studetit talk on lesson subject, and pupil no-responsf-. 

It should be noted that the TPQR had undergone considera':^le developmental 



Table 1. Time for Project Developnent 



1975 
July 1 

Aug 1 



Sept 1 



Oct 1 



Developnent of 
Project Design 

Selection of 21 
junior-level 
teacher trainees 
in special educa- 
tion as subjects 

Completion of 
Coder Training 
materials (train- 
ing lanual, 2 
training audio 
tapes, scripts 
for verbal prac- 
tice, selection 
of "live" class- 
room training tape, 
criterion tape) 
Selection of 11 
mildly handicapped 
pupils 

Selection of 8 
coders 

Pretesting of 11 
pupils on standard- 
ized reading diag- 
nostic and achieve- 
ment tests by 
trainees 
Scheduling of 7 
training sessions 
for coders (14 hours) 
Criterion testing of 
coders on TPQR cate- 
gory systm (Oct. 28) 
Developnent of lesson 
plan fomat 



Nov 1 - 



Dec 1 



1976 
Jan 1 



Design Computer Print- 
outs 

Begin classroom coding 
of Baseline Teaching 
of 21 Tutors on the 
TPQR category system 
(Nov. 3), Each tutor 
observed and coded 
twice weekly 

Schedule maintenance 
check with expert 
coder in "live" 
classroom tutoring 
situation (Dec. 3, 4) 



Schedule second main- 
tenance check of 7 
coders (Jan. 16-17) 
on Criterion Tape 
Revise observer train- 
ing manual 

Continue Baseline Ob- 
servations 



Feb 1 - Continue Baseline Ob- 
servations (9-14 
lessons) 

- Assign trainees to 
feedback conj^itions 

- Give all trainees a 
copy of Module 1 

Feb 15 - Give copies of Module 
3A, 33 or 4 to tutors 
in CATTS Feedback Groups 

- Begin First Treatment 
Phase - Administer 
Daily Computer Printouts 



March 1/- Continue First Treat- 
ment Phase 

- Administer Module 3B 

to Supervisory Feedback 
group 

March IS - Begin Second Treatment 
Phase 

April 1 - Continue Second Treat- 
ment Phase (5-8 
lessons) 

April 15 - Begin Maintenance 
Phase (2 lessons) 

May 1 - Administer project 
evaluation ques- 
tionnaire to all 
trainees l$! 

- Interview all pupils . 
with pupil question- 
naire 

- Administer Posttests 
to 11 pupils 

June 1 - Analyze all Data 

July 1 - W'.ite up Final Project 
Report 
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• Table 2. Categories of the TPQR Observation System 

Teacher-Pupil Question Response (TPQR) 
Observation System 

I. DISCRIMINATION 
1 1 . RECALL 
III. SEQUENCING/PARAPHRASING 
IV. HIERARCHICALLY RELATING 
V. INFERENCE 
VI. PROBLEM SOLVING 
VII. TALK ON LESSON SUBJECT 
VIII. "NO", "I CAN'T", NO RESPONSE, "I DON'T KNOW" 
IX. NOT CODABLE 
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testing before reaching its final version. The system had been developmentally 
tested for two months with the DITRMA consensus-coding system described in 
Semmel 5 Olson, (1977) . Both audio and video tapes of classroom teacher- 
pupil interactions and classroom simulations were coded on button boxes during 
developmental testing of the utility of the system. The end product of this 
activity was an observer training manual including rules for button box coding 
(See Module 1, Appendix F) . Scripts for practice coding and coder-training 
videotapes for training observers on the TPQR category observation system with 
DITRMA were also designed. Two training videotapes were produced. The tapes 
contained 39 and 36 question-response interaction segments, respectively^. The 
categories of the TP(^R were equally represented in the tape segments. The 
segments were taped 4pproximately ten seconds apart. A script of the two 
training tapes appears in Appendix A. Additional training tapes which were 
developed for the Cog Strat Observation Category-Coding System (Semmel, Sitko, 
et.al., 1976) were used for additional training tapes when needed. Additional 
written example" • jil also constructed to supplement the verbal exercises 
contained in ae observer training manual (See Appendix B) . Two live video- 
tapes were selected of tutoring situations similar to tho^e which the 
coders would be encountering in their live coding as coders. Finally a video- 
taped criterion test was constructed to test coder competency on the TPQR. 
The criterion tape contained 76 question-response interactions. All question- 
response categories were represented six times. Adding six examples of the 
categories *'tnTk*', "no-response", and "not codable" meant that a total of 166 
entries hac to be coded on the criterion tape (See Appendix C) . Following 
production of these training and criterion materials, they were tested with 
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a number of CITH personnel. The primary goal of this testing was to estimate 
training time for scheduling purposes and to identify specific training 
problems. Following developmental testing of training materials^ final versions 
were made. 

Observer Training: Eight coders were hired through advertisement in the 
Indiana University student paper. At hiring, coders were told that they would 
be taught to code the classroom interactions of special education trainees 
using the TPQR category observation-coding system. They were warned that only 
those coders who achieved the required inter-and intra-rater criterion relia- 
bilities would be used in the project. Table 3 provides an outline of the 
seven training sessions which covered a total of 14 hours. Acquisition of 
observation skills was facilitated by the computer-aided DITRMA consensus- 
coding system. 

Following the seventh training session, coders were given the criterion 
test using the previously described training tape. The criterion tape was 
coded twice by each trainee with an interval of ten minutes between the two 
criterion codings. Both inter-observer criterion-related and intra-observer 
measures of observer agreement were obtained using the simple percent agree- 
ment measure developed by Frick and Semmel (1974) . As recommended by Frick 
and Semmel, a simple percent agreement ^.85 for each category was required 
for the criterion-related agreement measure before actual data collection, 
could commence. Frick and Semmel (1974) have also recommended that measures 
of intra-observer agreement be obtained by showing the criterion tape contain- 
ing unambiguous isolated examples twice to all observers in conditions 
parallel %q those encguntered in the filed, The purpose of an intrarobserver 
agreement measure is to demonstrate th'S - extent to which each observer can 
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Table 3. Outline of Coaer-training Program (14 hours) 



Training Sessions (total of 14 tirs.) 

At hiring, trainees were assigned to read the training manual and to 
fill in the paper-pencil exercises. 

Session 1 - Conceptual overview of the categories 

(2 hrs.) - Exercises of the first 4 categories were phecked and problems 
discussed. 

Session 2 - Discussion of manual and checking of exercises was completed 
(2 hrs.) for the entire manual. 

- Coders were introduced to DITRMA system. Coders practiced 
Training Tape I coding State 1 only (see p. 3 of the manual). 

Session 3 - Practiced coding Training Tape I. , 
ilH hrs.) 

Session 4 - Practiced coding Training Tape I and II. 
ilh hrs.) 

Session 5 - Practiced Training Tape II and two Cog Strat Training tapes. 
ilh hrs.) 

Session 6 - Coded Training Tape I and II. 

(2 hrs.) - Practiced coding verbally read continuous script. The DITRMA 

feedback system was used without the videotape. This procedure 
was used to approximate live-speed coding skills. 

Session 7 - Practiced coding from verbally read continuous scripts as in 
(Ih hrs.) Session 6. 

- Practiced coding from live-tapes. 
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consistently code under actual observational circumstances. Hence, an overall 
proportion of agreement measure ^ ,85 was also demanded for the intra-coder 
criterion measure before coders were allowed to begin classroom coding. 

The criterion tape was coded twice (on October 28, 1975) by each coder 
trainee, with an interval of ten minutes between the two criterion codings. 
Four coder trainees passed with criterion-related agreement scores ranging 
from .89-. 98. The average score was ,93. In addition to criterion-related 
agreement, intra-observer agreement measures were also obtained. All four 
trainees who had exceeded the .85 criterion-related agreement standard also 
exceeded the preset intra-observer agreement standard of ,85. The range was 
from ,88-, 96, with an average score of ,92. The remaining 4 trainees had two 
more training sessions {i.e., 4 hours) with the DITRMA system and then took 
a second criterion test. Their second criterion-related agreement scores 
ranged from ,90 to .96, The average score was ,94. The intra-obsorver agree- 
ment scores ranged from .94-1.00, with an average score, of ,97, Hence, the 
final range of criterion-related agreement scores was from ,89- ,98, with an 
average of .94, The final range of intra-observer reliability scores was 
,88-1.00, with an average of .94. 

Once actual classroom coding commenced (in November), both criterion- 
related and intra-coder measures were obtained for coder maintenance checks 
as well. These maintenance checks were conducted about on-third of the way 
through the project. In addition, "live'' maintenance checks using a GITH 
staff expert coder were performed throughout the study in order to give the 
CITH staff an indication of observer agreement with an expert during actual 
coding of classroom lessons. This was also done for reasons beyond that of 
obtaining agreement estimates in situ. Since observers never knew exactly 
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when the expert coder was going to double-code a given lesson, it was intended 
that observers would always anticipate such a possibility and come well -pre- 
pared each time. Reliability maintenance checks using the live coder were 
actually performed during the initial coding of tutor lesson (i.e., Baseline 

\ ■ 

Teaching Phase) at the end of the first semester (December 3 and 4). The 
results of the maintenance checks revealed that the majority of the coders 
again exceeded the .85 standard on this initial maintenance check. The average 
score was .86, with a ^. nge of .71-. 97. 

At the beginning of the spring semesti^r there were 7 coders still avail- 
able. A second maintenance check was conducted at the beginning of the 
semester (January 16-17) . The criterion tape was used to check coder perfor- 
mance. Three coders were able to pass the criterion without additional practice 
and training. Their criterion-related agreement scores ranged from -94-,^/. 
The average was .95, Their intra-observer agreement scores averaged with 
a range of .91-. 98. The remaining four coders had additional tiainir ind 
then retook the criterion test. Their resulting criterion-related agreement 
scores ranged from .87-. 94. with an average score of ,91, The intra-observer 
agreement scores averaged .94, with a range of .90-. 99, Hence ^ the final 
range of criterion-related agreement scores was from .87-. 97, with an average 
of .93. The final range of intra-observer reliability scores was ,90-. 99, and 
the average was .94. While observational data was initially being collected 
during November and December, coders provided the CITH staff with feedback 
concerning their impressions of the adequacy of the TPQR observation system 
and the observer-training manual (i.e.. Module 1, Appendix F) . Based on this 
•feedback and the observations of the CITH project staff, clarifications and 
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modifications were made on the training manual. The use of the revised 
observer-training manual began in the second semester by the preservice 
trainees in the project. See Appendix IJ, for examples of clarifications. 
^ ^ • Tutor Backgro und, Practicum Objectives and Tutoring Procedures 
Tutors : The tutors in the project were 21 Indiana University undergraduate 
students, all special education junior-level majors enrolled in K495, Practicum 
in Special Education, under the direction of Dr. Sitko, during the fall and 
winter semesters, 1975-1976. All tutors (19 females and 2 males) were majors 
in the Program for Training Teachers of Mildly Handicapped Children (MHP) , a 
two-year teacher education program specifically designed for preservice teachers 
who desired to teach mildly handicapped children in special and/or regular 
classroom environments. Tutors received three hours- of academic credit for 
each of the two .?rs. tv... j<^;uusLt; Te^icher Laboratory Practicum was 

required for all junior-level trainees in the MHP. 

Tutor T rainin g and Introduction to Practic um O bjec ti ves : The 21 preservice 
trainees were introduced to the practicum through classroom lectures at the 
beginning of the first semester. They were told that they would tutor one 
child, for two, one-half hour periods, during each week of the two semesters. 
They were also told that the practicum was designed to meet the following 
objectives: 

1. To provide a laboratory classroom in which to practice and 
develop selecting teaching skills, 

2. To assist a handicapped child who is below grade level in 
reading to improve his/her listening and reading comprehension 
skills. 
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3. To assist trainees in refining interactive teaching questioning 
skills by providing feedback on teaching performance. 

During the initial 1 1/2 months of the practicum (August 25 - October 10), 

the trainees were taught how to give and interpret information and 

standardized reading tests. They were also taught how to write lesson 

plans using a decision-making model for diagnostic teaching developed 

by Gillespie and Sitko (1974). In addition, they were introduced to 

several reading curricula and teacher training multimedia packages 

at CITH. Specific CITH teacher training packages which were completed 

during this period included: (a) Specifying Behavioral Obj actives; 

(b) Task Analysis; (c) Choose A Curriculum Package; (d) TeachbT: 

Made Reading Materials for the Handicapped; (e) Observing and Recording a 

Child's Behavior, (f) Informal Reading Inventory;, and (g) A Decision-Making 

Model for Teaching the Handicapped. Descriptions of these teacher training 

packages are found in the "Directory of CITH Training Materials'* published 

by CITH (1976). 

Teacher-Pupil Selection and Tutoring Procedures : Tutors began working with 
their respective pupils at the beginning of October. Ten mildly handicapped 
(EMR) aid one trainable mentally retarded child were the pupils worked with 
in this practicum. All children lived in a nearby rural community and were 
enrolled in a cooperative special educational program at the Indiana University 
Developmental Training Center (DTC) • All pupils had been referred by their 
own school district as requiring a special educational program. The tutors 
and pupils were selected in a basically random manner to work together. The 
basic determinant to matching was corresponding time schedules between tutors 
and pupils. This method proved satisfactory and there were no changes required 
due to personality conflicts, etc. Before tutors began tutoring their pupils. 
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they gave them various informal and standardized tests under the direction of 
their DTC laboratory class teacher (B. Miller) . This experience gave them 
the opportunity t^o familiarize themselves with the pupils and to assess entry 
level of their pupils on various reading skills. These measures included: 
(a) the Wide Range Achievement Test (WRAT) ; (b) the Survey of Primary Reading; 
(c) the Dolch Word List; (d) the Gates-MacGintie Reading Test, (e) the Peabody 
Picture Vocabulary Test (PPVT) ; (f) the Alphabet Identification Test; and 
(g) the Boehm Test of Basic Concepts. The pretest results of the tests are 
shown in Appendix H. 

Each tutor began actual tutoring of his/her child for a half-aour session 
twice a week beginning at the end of October. The lessons v.-ere ready-orieated, 
with each les$on containing an entry test, the body and an evaluation. The 
tutors were required to submit a lesson plan and task analysis to the class- 
room teacher at least five days before the actual lesson was scheduled to be 
taught. The required forma*^ writing lesbon plans are given i:i Module 2, 
Appendix G. The classroom teacher graded each lesson plan using the Checklist 
for Lesson Plan Evaluation shown in Module 2. This form rates each section 
of the lesson plan (i.e., Entry test, task analysis, objectives, criterion 
test for main and subobj ectives and teaching strategies) on a five-point 
scale. The evaluation sheet was returned to tlie teacher each time a new 
lesson was submitted. The scale shown on the evaluation 5lieet,was only used 
for the trainees' guidance in interpreting the lesson plans, but vyag not used 
in gr^ding^ Besides evaluation of lesson plans- and necessary feedback 
concerning them, the classroom teacher was available to give advice to each 
tutor. Lesson objectives were evaluated in terms of their appropriateness to 
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the instructional level of the child. 

CodiTig Procedures : All lessons which were coded took place jn Monday through 
Friday between 8:30 and 12:00 noon. The trainees taught in a laboratory class- 
room at the I.U. Developmental Training Center (DTC) . During the first semester 
there were two tutoring stations in this classroom with wooden partitions 
separating each station. Hence, two tutors were able to have lessons scheduled 
a': the same time. Tutors rotated between the two tutoring stations for each 
lesson. For the second semester, the tutor's academic schedule necessitated 
the addition of a third tutoring station. Hence, three tutoring sessions took 
place at one time during the second semester. Tutors were randomly assigned 
and rotated among the three stations for each lesson. Each tutoring station 
contained a small table and two chairs as well as a microphone, and each was 
isolated from the adjacent stationCs) by the wooden eight-foot partition. 
Each table faced a one-v/ay mirror, which ran along one side of the classroom. 
Behind the one-way mirror wis a small room which contained the observation- 
coding station. Videotape cameras were installed in tyo of the tutoring 
stations. 

The coder station contained four coding button boxes which were hooked 
up to the PDP-12 computer located in a nearby building, the Teacher Education 
Laboratory (TEL) at CITH. Other components in the station included an intercom 
to the computer center, two videotape recorders, a videotape monitor, six sets 
of earphones [two sets for each coding station) and three coding boxes. Before 
the coding began each morning, the equipment was turned on to check its working 
order. The TEL at CITH was contacted by intercoms to check if the computer 
equipment was in order there. ITie button boxes which provided the link to the 
PDP-12 computer were then turned on and the lesson coding was begun. The 
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actual method used for transmitting the tutor-pupil interaction to the com- 
puter is shown in Module 1 (Appendix F, pages 4-5). Codersr-^^ere assigned to 
tutors and stations on a rotating basis so that they did not code the same 
person twice in one week and to ensure that they coded at a different station 
during each lesson. See Appendix E for a weekly schedule including sample 
forms for recording coding sessions. A form was made out for each lesson to 
record the time of tutoring, the computer storage box number, the type of 
feedback being used and any special notations about the lesson. 

Two graduate students acted as coordinators for the daily coding activi- 
ties. One individual was responsible for (a) the coders* scheduling, (b) 
assi^ing-coder and tutor to a specific station for each lesson, (c) filling 
out the individual rocoT'd sheet for each tutoring session, (d) recording the 
computer storage box number for each session on the individual record sheet, 
(e) setting up maintenance checks for coders, and (£) conducting practice and 
training sessions for those who needed additional coding experience. 

The other coordinator worked primarily with the tutors and with data 
organization. Her activities included the following: (a) she kept records 
of student attendance; (b) ensured that each student received the proper 
feedback at the proper time; (c) filed the printout^ information for each 
session; and Cd) listed and filed the videotapes from eacK lesson that w^.s^. temped 
In essence, both coordinators served as general overseers of the day-to-day 
coding operations. 

III. Teaching Phases and Experimental Design 

There were three teaching phases during the project. These v^ere; CI) 
baseline, C^) feedback and^ C3) maintenance. 
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Baseline : In the baseline teaching phase, trainees taught the lessons they 
had prepared without receiving CATTS or supervisory feedback on their lessons. 
The baseline lessons of the tutors were coded beginning November 3, 1975. 
The number of lessons taught without feedback varied from trainee to trainee. 
The baseline teaching always included at least the first nine lessons and 
varied up to the first fourteen lessons taught the baseline phase immediately 
followed the coder training phase of the project. 

Feedback : Following baseline observations, each trainee was randomly assigned^ 
using a table of random numbers, to one of three feedback conditions; C^) GATl'S 
Instantaneous Scope Feedback, {h') CATTS Delayed Video Feedback, and (c) Super- 
visory Feedback. All subjects then received a copy of Module 1 (Appendix F), 
which presented a memo outlining the four criteria that determined the grade 
in the practicuin and the major instructional objectives for the rest of the 
semester. The module futther contained; (a) a description of the CATTS system, 
fb) the role of feedback in skill development and decision-making, and (c) 
the same TPOR observer-training manual (Module 1 minus page 4) developed by 
Heshusius and Sitko (1976), which was used earlier in the fall semester in 
training the project coders. The training manual described the terminology 
and definitions of TPQR observation system, together with examples of each 
category and exercises for coding. Tutors were instructed to learn to discrim- 
inate each category on the TPQR system although they would not need to actually 
code any lessons since coders had been hired for that purpose. Tutors in the 
CATTS Instantaneous Scope and Delayed Video Feedback conditions were next 
provided with either Module 3A '>r 3B ^ which explained the type of feedback they 
were to receive. 
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Scop Feedback : Those who were to have Scope Feedback received Module ' 

Interpretation o£ Printout Feedback with Scope (see Appendix I). This module 
provided an example of the CATTS Printout Sheet they would receive immediately 
following each lesson. It also provided a clear explanation of every item on 
the printout, as well as the four major teaching goals or objectives for the 
balance of the semester. The first major goal indicated that teacher rate 
for each lesson should be 30-50% of all teacher verbal interaction. This 
criterion was selected in order to allow sufficient opportunities for the 
pupils to answer questions and receive appropriate feedback and probing on 
their responses to questions. Our previous experience with preservice trainees 
had revealed that they initially asked a preponderance of questions during 
tutoring lessons (over 50% of the total lesson), and provided relatively few 
opportunities for student-initiated talk, probing student responses, or 
positive feedback. The second major goal was to maximize the percentage of 
high-level questions relative to the percentage of low-level questions. 
As mentioned previously, the literature indicates that teachers in both 
regular and special classrooms use a greater percentage of factual or low- 
level questions in reading instruction. The third major goal was to ask in 
sequential order the total hierarchy of six questions on the TPQR system. It 
was felt that this goal would facilitate hierarchical questioning skills on 
the part of the tutor by providing a suggested pattern of questioning. The 
fourth and final goal was to obtain appropriate pupil responses to cognitive 
questions asked. For instance, if the tutor asked an inferential question 
from the pupil, then an inferential response was expected from the pupil. A 
matrix was shown on the printout which illustrated the .tutor's efficiency in 
obtai.ning appropriate responses. The diagonal in L'le matrix showed the number 
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of "appropriate matches" made. An ''appropriate match" occurred each time the 
tutor asked any question in the TPQR hierarchy and the pupil responded at the 
same level. The numbers in the two seginents of the matrix gave the instances 
by cognitive level when the pupil response to a teacher question was at a 
lower or higher cognitive level in the TPQR system than the question asked. 
The printout also provided a summary of the teacher-pupil interaction sequence 
across time during the lesson (see Module 3A- Appendix I). 

The seven tutors in the Scope Feedback condition also received Module 4, 
GATTS Scope Feedback (see Appendix Jl. This module described the display on 
the GATTS video monitor which would be observed during the actual lesson. It 
mentioned that the screen would display a moving bar graph that changed as the 
tutor questioned the pupil. The bar garph would also show the tutor which 
questions she/he had asked up to thie moment of observing the screen, and the 
relationship between use of the six different questions to each other. More- 
over, a number would appear in the upper right-hand comer which would indicate 
the percent of teacher questions up to the moment. The module presented three 
examples describing how the display "worked," In addition, the module indicated 
that an arrow would appear which would help the tutor complete the six- 
question hierarchy. Rules were given for movement of the arrow on the visual 
display. The tutor was told that the arrow would point to the cognitive 
category at which he/she should be questioning at that point in the lesson 
in order to move the arrow sequentially up the TPQR hierarchy. In addition, 
the printout described in Module 3-A provided a matrix which designated the 
"hits" or, times the tutor asked questions at the same level indicated by the 
arrow on the GATTS scope. 

Video Feedback: Those seven tutors who were to have GATTS Delayed Video 
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Feedback after their lessons received Module 3-B--Interpretation of Printout 
Feedback (see Appendix K) before they received any feedback. Module 3-B was 
identical to Module 3-A which the Scope Feedback Group received, except that 
it gave no reference to the scope monitor or the matrix which described 
teacher questions by indicating question level Ci«e., Matrix 1). Otherwise, 
the same printout and four practicum goals were described as in Module 3-A. 
The tutors in the Video Feedback Group were told that they would have the 
opportunity to view their lessons on videotape immediately following their 
lessons. Tutors in both the GATTS Scope and Video Feedback Groups also 
received^ as part of^Module 3^ of the graph 

they would next receive summarizing their baseline performance. This graph 
plotted the percent of high-level teacher questions and the percent of high- 
levol pupil responses across each of the baseline trails (see Module 3-A and 
3-B). 

Supervisory Feedback : The seven tutors who were to obtain Supervisory 
Feedback received Module 1 [Appendix F), as did the other two feedback groups. 
However, they were only given the four teaching goals, and did not initially 
receive Module 3-B, It was not until they had taught fcur post-baseline 
lessons that they received Module 3-B. After the tutors in the GATTS Instan- 
taneous Scope and Delayed Feedback Groups received and read their modules, 
they were provided with the graph which summarized their performance during 
baseline trails. As mentioned previously, these graphs showed (a) the percent ot 
high-level teacher questions over the total questions asked, and (h) the 
percent of high-level pupil responses over the total pupil responses. High-level 
teacher questions and responses included the Sequencing-Paraphrasing, 
Hierarchical Relating, Inference and Problem-Solving categories on the TPQR. 
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They were also instructed in procedures for using the printout information 
which they would receive after each lesson to evaluate their lessons and to 
graph the frequency of occurance of high-level teacher questions and 
pupil responses. The Supervisory Feedback Group received their baseline graphs 
only after they had completed their four lessons with supervisory feedback. 
Actual feedback for all trainees began on the next lesson following the last 
baseline trial . 

Feedback Procedures : Beginning with each feedback lesson, a CATTS-TPQR Record 
was turned into the TEL for each session (See Appendix L) , The purpose of the 
Coding Record was two-fold. First, it provided data for the TEL personnel to 
determine who was teaching at a certain time and the type of feedback they 
were to receive. Secondly, it contained most of the information necessary to 
construct, the 12-bit word for the computer header card which was located in the 
computer at TEL. On this form the coder number was not included until the 
actual lesson time. Therefore, it was necessary for the TEL computer personnel 
to call the Observation-Coding Room to receive that number. This frequent 
contact between personnel at the TEL and the coordinators in the Observation- 
Coding Room ac the Developmental Training Center provided the opportunity for 
close communication between those in the building where the obser- 
vation took place, and those working in the TEL, 

Trainees who received the CATTS Instantaneous Feedback always had a video 
monitor on the table in front of them which displayed the frequency of the six 
types of questions on the TPQR that the tutor asked at any moment during the lesson. 
The scope showed the relationship, in the form of a bar graph, between the use 
of the six different questions. Superimposed within each of the six bars on 

c:w , 
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the graph was the number of pupil responses at the same cognitive levels as 
the questions asked. The bar graph did not display pupil responses on a 
cognitive level different from that of the question asked, (see Figure 2 and 
Module 4, Appendix J.) As mentioned previously, the scope also showed-- 
upper right-hand corner—the percent of teacher questions asked at any point in 
time during the lesson, and an arrow which showed the indicated question level. 
The moving arrow appeared under the abbreviations for the six question levels. 
The scope was in the tutor's view throughout the lesson and instantaneously 
portrayed changes in frequency of questions as they actually occurred during 
the lesson. The scope reflected the changes in questioning within one second 
after the observer coding the lesson pushed the "send" button on the button 
box, and sent the information into the PDF computer at the TEL. Hence, this 
group obtained instantaneous or immediate information on the criterion teaching 
•behavior in situ while teaching. In addition, following their teaching, they 
received printouts summarizing their lessons, as did the Video Feedback Group 
and the Supervisory Feedback Group (after four feedback sessions). All trainees 
were required to continue to graph the percent of frequency for high-level questions 
and pupil responses after each printout was received. These data were recorded 
on the cumulative individual graph received earlier which had included the 
trainees' baseline percentages. 

After each lesson in which feedback was- involved, each tutor went to the 
TEL to pick up his/her printouts. The printouts were usually ready within 10 
minutes after tire lesson. Those trainees who received video feedback then 
viewed and heard their videotapes on a TV monitor in a room adjacent to the 
TEL. Their lessons had previously been videotaped by one of two videotape 
cameras which were installed in two of the three teaching stations. They were 
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Figure 2. Bar graph displayed on video scope or screen showing six question categories 

for trainees receiving instantaneous visual feedback (See Module IV, Appendix J) 
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told to focus on the four stated practicum objectives illustrated on the 
printout as they viewed the videotapes of their lessons. Those trainees who 
were given supervisory feedback received a subjective evaluation from one of 
the two project coordinators, who discussed lesson content and appre-riateness 
in view of the same four practicum objectives. The two supervisors were 
also instructed to focus on any other teaching behaviors they considered 
relevant, and to answer any questions the tutor might have pertaining to 
his/her lesson. However, after their fourth feedback lesson, these seven 
tutors began to receive computer printouts from the TEL after each lesson, 
as did the two CATTS Feedback Groups. They were also required to graph 
the percent of high-lvvel questions and high-level pupil responses from 
the lesson printout on their cumulative graphs. The total feedback phase of 
the project actually varied between nine and twelve lessons taught for each 
trainee. 

Maintenance : Following the feedback phase of the project, all trainees entered 
a maintenance phase for their final two lessons. This phase was identical 
to the baseline phase in that trainees tutored their children without receiving 
feedback on their tutoring lessons. However, their reading lessons were again 
coded on the TPQR category system as they were during the baseline phase. 
During the total project period, each tutor had at least three lessons video- 
taped, including a baseline lesson immediately before feedback was begun, the 
last feedback lesson, and the last maintenance lesson after feedback was 
terminated. The total experimental design for each of the three teaching 
phases of the project is displayed in Figure 3, 
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Figure ?. Experimental design for the four teaching periods of the project 
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Data Sources 

The main source of data obtained during the project was the daily teacher- 
pupil observational data collected by the coders on the TPQR category-coding 
system. The CATTS system served as a data collection as well as a feedback 
mechanism. The system not only collected all daily observational data for 
the sessions coded, but also transferred the data to the university main 
computer center for permanent storage. Daily observational data were collected 
on several dependent measures including: (a) percent of teacher questions- 
defined as the number of questions the teacher asked divided by all teacher 
behavior; (b) percent of high-level teacher questions over the total questions 
asked; (c) percent of high-level pupil responses over total responses; (d] 
percent pupil no responses over total pupil responses given; and (e) percent of 
approximate matches which included the times the teacher asked any question 
in the TPQR hierarchy and the pupil responded at the same level. Additional 
data were collected from several other sources discussed below. 

A fifteen-item questionnaire was given to the tutors at the end of their 
practicura (i.e., the first week in M^X) • questionnaire asked students to 

evaluate on a six-point scale ^|)Q^y opinions cpncqrning several aspects of the 
two-semester practicum (see Appendix Q). At the end of the practicum the 
project staff also interviewed each of the eleven pupils and asked them seven 
questions concerning their feeling towards their own tutor and the practicum 
itself (see Appendix R] . In addition, all pupils were given posttests on the 
same six standardized reading and achievement tests given before the practicum 
began (see Appendix H) , The final source of data was based on an evaluation 
of the three videotaped lessons taught by each trainee across the three eaching 



phases of the project. The three videotaped lessons of each student included 
the last baseline lesson before feedback, the last feedback lesson, and the 
last maintenance lesson after the feedback phase of the project- The three 
lessons were rated using a sign observation system developed by Lynch and 
Everton (1976) . The purpose of the evaluation of tapes on this particular 
system was to determine if there were any other concurrent effects of asking 
pupils higher-level questions. The systeni was designed to obtain measures of 
the amount of elaboration of the pupil's response and to determine if any 
qualitative changes took place over the duration of the tutoring experience. 
A copy of the system is shown in Appendix N. The evaluations of all three 
videotaped lessons of each tutor were done by two coders who had .98 relia* 
bility with each other. The results of the various sources of data collected 
during each teaching phase of the project are presented next. 



CHAPTER FOUR 
RESULTS § DISCUSSION 

The design used to analyze the tutor observational data was a repeated 
measures ANOVA design with one between factor. Feedback Conditions or Groups 
C ], and one within block factor. Periods (?) , The original design 
contained a third possible factor — different variations of baseline and 
treatment trial combinations — but due to inconsisti :t tutor-pupil schedules 
and some missing observations, this baseline/ treatment factor was never 
fully completed. Therefore, each tutor's trials were collapsed within the 
various baseline, treatment and maintenance periods, and one average-perform- 
ance percent score per period was calculated. The percentages of frequency 
of the main dependent measures across each daily lesson were utilized in the 
analyses . 

The first analysis was performed on the percent of teacher questions. 
As indicated previously, the criterion measure for the percent of teacher 
questions was defined as the number of questions the teacher asked during 
the lesson divided by all teacher behavior subsumed on the TPQR category 
system. Table 4 *^hows the average percent of teacher questions across each 
of the four teaching periods [i.e., baseline, (P^), first treatment period CP^)* 
second treatment period (Pj)* and maintenance C^^) J for each of the three 
feedback groups [i.e., CATTS Video Feedback CG^), Supervisory Feedback (G2), 
and CATTS Scope Feedback CG^)]. It should be recalled the first treatment 
period [i.e.. 0^2^^ represents tutor performance during the first four 
feedback trials following the baseline period. On the other hand, the second 
treatment period [i.e., (P3)] represents tutor performance after the fourth 
feedback trial. This latter treatment phase varied between five and eight 
feedback lessons for individual tutors. The total treatment phase of the 
project CP2 * varied between ten and twelve lessons. 
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Average Percent Performance 



(Gi) . 
CATTS DE- 
LAYED VIDEO 
FEEDBACK 
GROUP 

(G,) 

VISORY 

FEEDBACK 

GROUP 

(G3) 
CATTS IN- 
STANTANEOUS 
SCOPE FEED- 
BACK GROUP 


Pi 

Baseline 


^2 

Treatment 1 


P3 

Treatment 2 


P4 

Maintenance 


88.75 


50.33 


40.37 


49.50 


81.78 


48.74 


52.60 


46.07 


85.79 


50.57 


50.08 


48.12 


Total X 


35.44 


49.38 


47.69 


47.90 



Table 4. Average percent of tcjacher questions across each of the 

four teaching periods for each of the three feedback groups. 
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Table 5 contains the analysis of variance source table for percent of 
teacher questions. F ratios indicated a significant finding in the period 
CP) main effect (p < .01). An examination of the means in Table 4 reveals 
that mean percent teacher questions were significantly higher during base- 
line trials than treatment or mainten^^^ice trials. Tliese results indicate 
that in general tutors initially dominated the tutoring lessons with teacher- 
controlled questioning during the baseline period. However, during treatment 
trials they were successful as a total group in reducing their mean percent 
of teacher questioning to 48.8%. As indicated previously, one of the major 
Objectives stressed to each tutor was to keep the teacher questioning rate 
below 50% of all teacher verbal interactions. Hence, as a group the trainees 
were able to meet this criterion. Moreover, they were able to maintain this 

^criterion during the maintenance period (X = 47.9%). Table 5 further reveals 
significant Feedback Group, by Period interaction (GP) c (p < .05). Due to 

' this significant interaction, a simple main effects analysis (Kirk, 1968) 
was performed on G and P to qualify the main effects. The results of the 
simple effects analysis are. also indicated in Table 5. Figure 3 illustrates 
the GP interaction plot. The results of this analysis revealed that the 
three feedback groups did not differ significantly (p > .05) during (a) 
baseline trials (Pj) , (b) the first treatment period (P2), or (c) the m^inr^ 
tenance period CP4) • However, the groups did differ significantly during 
the second treatment period. To further clarify this significance, Tukey 
post hoc analyses (Winer, 1971) v;ere performed on the means whicli are plotted 
on Figure 3. The results of the post hoc analyses indicated that the Video 
Feedback group asked significantly fewer questions (p < .05) during the 
second treatment period than the Supervisory^ Feedback Groups. On the other 
hand there were no other significant group differences at any of the other 



Table 5. Analysis of variance table for porcent of teacher questions, 



Source ^ S S df MS F 



Betweeii Subjects 3499.57 20 

Groups (G) 35.22 2 17.61 <1 

Between. G at 171.53 2 85.77 <1 

Between G at P2 13.87 2 6.94 <1 

Between G at P3 : 583.22 2 291.6). 3.36* 

Between G at P4 41.67 2 20.84 <1 

Within cell 72 86.78 



Subject with groups S (G) 3464.35 18 lD-'.46 



tfithin Subjects " 25123.98 63 

Periods (P) 21564.78 3 7188.26 139.42^* 

Between P at G| t9694.64 3 3231. Si. 62. 68** 

, Between P at G2 5743.81 , 3 1?;4.60 37.13** 

Between P at G3 69.01.25 3 2300.42 44.62** 

GP ■ 775.09 6 ' 129.18 2.51* 



-P X subj. w groups SP (G) 2784.11 54 ' 51.56' 

fatal . 28623.55 83 



*p<.05 
•*p<.01 
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Figure 4, 



Mear. percent of teacher questions across four teaching periods for each of the 
three feedback groups (GP interaction], :,\ . 
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periods of the project. Nevertheless, all three feedback groups maintained 
their questioning performance at approximately the same level during the 
final maintenance period. 

The results of the simple effects analysis also revealed several 
significant within-group comparisons for each feedback group across the 
various period. These significant comparisons were further analyzed using 
Tukey and Scheffe post hoc analytic procedures. For each feedback group, 
the Scheffe analyses revealed that each group significantly reduced their 
questioning performance between the baseline and the two treatment periods 
(p-«l,01). However, none of the within-group comparisons between the two 

treatment periods CP § P-) were significant Cp 7.05). Similarly, none of 

2 

the within-group comparisons between the two treatment periods and the 
final maintenance period were significant (p>,05). 

The second variable that analyses were performed on was the percent of 
high-level questions asked during each lesson over the total questions asked. 
It should be recalled that, during the feedback phase of the project, all 
trainees were asked to significantly increase their high-level teacher questioning 
over their mean baseline rate. Table 6 gives the mean percent of high-level 
teacher questions across each of four teaching periods for each of the three 
feedback groups. Table 7 contains the analyses of variance source table for 
percent of teacher high-level questions. F ratios indicated a significant 
finding in the period (?) main effects (p<.01). An exmaination of the 
means in Table 6 reveals that the mean percentage of high-level teacher 
questions was definitely higher during treatment and mainteance trails than 
during baseline trails. Tukey post hoc analyses of the CP) main effect 
further revealed that the three groups as a whole significantly increased 
-their-percentage of ^high-^lev^l -questions between -t4ie-taseli^^ - 
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MEAN PERCENT PERFORH\NCE 





Pi 

BASELINE 


P2 

TREATMENT 1 


P3 

TREATMENT 2 


P4 

MAINTENANCE 


CATTS DE- 
LAYED VIDEO 
FEEDBACK 
GROUP 
(Gi) 


14.97 


31.57 


42.22 


38.79 


SUPERVISORY 
FEEDBACK 
GROUP 
(G2i 


14.86 


25.45 


24.97 


36.64 


CATTS IN- 
STANTANEOUS 
SCOPE FEED- 
BACK GROUP 


17.07 


29.50 


31.12 


29.71 


Total 
X 


15.63 


28.84 


32.77 


35.05 



Table 6. Mean percent of high-level teacher questions across 
each of the four teaching periods for each of the 
three feedback groups. 
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Source 


ss 


df 


MS 


F 


Between Subjects 


4289.52 


20 






Groups (G) 


637.33 


2 


318.67 


1.57 


Subj . with groups S (G) 


3643.19 


18 


202.40 




Within Subjects 


10151.63 


63 






Periods (P) 


4746.46 


3 


1582.15 


18.98** 


GP 


004.50 


6 


150.75 


1.81 


P X Subj . w groups SP (G) 


4500.67 


54 


83.35 




Total 


14432.15 


83 







*p .05 
••p .01 



Table 7. Analysis of variance table for percent cf teacher 
high-level questions. 
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treatment periods (p<,01). However, further increases between the two 
treatment periods and between the second treatment and maintenance periods 
wer© not significant (p7.05). 

Table 7 also indicates that the main effects of periods were not qual- 
ified by a significant Groups by Period Interaction effect. Nevertheless, 
an analysis of the means in Table 6 suggests a trend towards greater in- 
creases in high-level questioning between baseline and treatment trials 
for the Video Feedback Group. The average proportional increase on Percent of 
High-level Questions for the Video, Supervisory and Scope Feedback Groups 
between baseline and treatment periods were respectively; 110%, 71%, and 
73%. The Supervisory Feedback Group revealed the lowest percentage of high- 
level questioning performance across the two treatment periods (P2 5 Pj). 
Ffowever, during the maintenance period, the Supervisory Feedback Group in- 
creased their mean percentage of high-level questions 47% relative to their 
percentage during the second treatment period. On the other hand, the other 
two feedback groups maintained their high-leval questioning performance at 
a similar percentage deirionstrat^d. in the second treatment period. 

The third variable tFuftt analysis was performed on was the peft^ent of high*. 

' i 

level pupil responses ove? the total responses given. As mentioned previously, 
all trainees were asked-to significantly increase their high-level pupil 
responses to teacher questions over their mean baseline ratio. In fact, 
this criterion was emphasized- as the most important goal in the project. 
Table 8 provides the mean percent of pupil hig?i-level responses for each of 
three feedback groups Across^-e^ch^of the four teaching periods,. Table 9 
contains the analysis of variance source table for percent of pupil high-level 
responses* F ratios indicated significant findings in the period (P) \ 
main effect (p .01) and in the Feedback Group by Period (G x P) inter-\^ 
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MEAN PERCENT PERl^ORMANCE - 





Pi 

Baseline 


.P2 
Treatment 1 


P3 

Treatment 2 


P4 

Maintenance 


CATTS DELAYED 
viucu r ecu DAL K 
GROUP (Gj) 


11 IQ 


?7 14 




^ 97 14 


SUPERVISORY 
FEEDBACK GROUP 
(G2) 


10.78 


19.43 


18.52 


... 26.07 


CATTS INSTAN- 
TANEOUS SCOPE 
FEEDBACK GROUP 
(G3) 


11.02 


23.81 


26.44 


24.60 


Total 
X 

i 


11.00 


23. 4R 


27.48 


25.94 



Table 8. Mean percent o£ pupil high-level responses across 
each of the four teaching periods for each of the 
three feedback groups. 



Table 9. Analysis of variance table for percent of pupil high-level responses. 



Source 


SS 


df 


MS; 


F 


Between Subjects 


3962.09 


20 






Groups (G) 


704.50 


2 


352.25 


1,95 


Between G at Pj 


0.59 


• 2 


0.30 


<1 


Between G at P2 


209.57 


2 


104.79 


1,21 


Between G at P3 


1270.42 


2 


635.21 


7.31** 


Between G at P4 


22.90 


2 


11.45 


<1 


Within Cell 




72 


86,85 




■ Subj. w. groups S (G) 


3257.60 


18 


180.98 




Within Subjects 


. 4642.84 


63' 






Periods 


3544.29 


3 


1181,43 


21,30** 


Between P at Gi 


2476.02 


3 


825,34 


14.88** 


Between P at G2 


823.55 


3 


:!74,52 


4,95** 


Between P at G3 


1043.70 


3 


,47,90 


6,27** 


GP 


798.97 


6 


133,16 


2.40* 


•P X subj. w. groups SP (G) 


2995.58 


54 


55,47 , 




Total 


8604.93 


83 







•J • 

*p<,05 

♦*p<.01 ' .. 
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action effect Cp-<.»05). An examinav^on of the means in Table 8 reveals 
that the mean percent of pupil high-level responses was significantly higher 
during each of the treatment and maintenance periods than during the initial 
baseline period. In fact, the proportional gain in mean percentage of high- 
level responses between the baseline and first treatrr^c^t period was 114^o. 
Due to the significant Feedback Group by Period Interaction, a simple main 
effects analysir* was performed on G and P to qualify the main effects. The 
results of the simple effects analysis are also indicated in Table 9. Figure 
4 illustrates the CP interaction plot. 

The results of thi:? analysis revealed that the three feedback groups 
did not differ significantly during; (a) baseline trials (Pj^), (b) the 
first treatiment period {.^2^' maintenance period (P^), However, 

the groups did differ significantly during the second trr^atment period. To 
further clarify this significance, Tukey post hoc analyses wpre performed 
on the means which are plotted in Figure 5. The results of the post hoc 
analyses indicated that the Video Feedback Group elicited a significantly 
greater mean percentage of pupil high-level responses during, the second 
treatment: period (P-r) when compared to the Scope Feedback Group (p<.OSj 
and the Supervisory Feedback Group (p^^.Ol), There were no significant: 
differences during this same treatment period between the Scope and Super- 
visory Feedback Groups. However, a Scheffe post hoc ans^lysis further re- 
vealed that the two CATTS Video and Scope Feedback Groups together elicited 
a significantly greater mean percentage of pupil high-level responses than 
the Supervisory Grca'p. 

'fhe results of the simple effects analyses also revealed several sig- 
nificant within-grouj comparisons for each feedback gioup across the various 
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Figure 5« Me:.n percent of pupil<ihigh-levei responses across xour ter.ching periods for each 
of the three feedbac!^ groups (GP interaction), 
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period. The significant comparisons were further analyzed using Fukey and 
Scheffe post hoc analytic procedures. For the CATTS Scope and Video Feed- 
back Groups, the analyses indicated that each group significantly increased 
their mean percentage of pupil high-level responses between baseline andvthe 
two treatment periods However, the increase in percentage of high- 

level responses for the Supervisory Group between baseline and each of the 
two treatment periods was not significant (pT'.OS), The analyses also- 
revealed that none of the within-group comparisons between the two treatment 
periods [P^ ^ ^3) each of the three feedback groups were significant 
(p ,05}. Similar ly, the within-group comparisons for each feedback group 
between the two treatment periods and the finii.1 maintenance period were all 
shown to be nonsignificant (p>.05). 

A separate correlational analysis was also made between the previous 
two dependent variables for the total group o^ tutors, A Pearson correla- 
tion coefficient between percent of teacher hig^-Ievel questions and high-level 
pupil respons^jrS wos calculated across the total four periods for the total ' 
tutor sample, A value of r = .944 was found. Hsnce, the analysis indicated 
a strong positive relationship between high-level questions and pupil re- 
sponses, rn fact, the correiation was significant at the ,003 level of 
significance. 

The fourth variable that analysis was performed on was the. percent of 
pupil no-responses to teacher questions asked during each lesson. Trainees in ail 
conditions were asked to minimiiie as much as possible the failure of their 
pupils to respond to their questions. In particular, they were asked to 
^ significantly decrease pupil no-responses from their mean baseline rate. 
Table 10 provides the mean percent, of pupil no-responses over' total responses 
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>{EAN PERCENT PERFOR>!ANCE 





Baseline 


^2 

Treatment 1 


Treatment 2 


P4 

Mamtenarice 


CATTS DELAYED 
VIDEO FEEDBACK 
GROUP (Gj) 


16.71 


13.62 


10.66 


17.07 


SUPERVISORY 
FEEDBACK GROUP 
(G2) 


19.70 


22.00 


18.92 


19.43 


CATTS INSTAN- 
TANEOUS SCOPE 
FEEDBACK GROUP 
(G3) 


20.30 


14.55 


13.79 


9.71 


Total 
X 


18.90 


16.72 


14.46 


15.41 



Table 10. Mean percent of pupil no-responses across the four 

teaching periods for each of the three feedback groups. 
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given. Table 11 contains the analysis of variance source table for percent of 
pupil no-responses. F rations indicated significant findings in the period 
(P) main effect (p<,05) and in the Feedback Group by Period (G x P) inter- 
action effect (p-<.,05). An examination of the means the Table 10 reveals 
that the mean percent of pupil no~responses decreased approximately 17,5% 
between baseline and treatment periods* Due to the significant Feedback 
Group by Period interaction, a simple main effects analysis was performed on 
G and P to qualify the main effects. The results of the simple effects analysis 
are also indicated in Table 11. Figure 6 illustrates the GP interaction. 
The results of this analysis demonstrated that the three feedback groups 
did not differ significantly during the four periods of the project (p^.OS). 
Moreover, the only significant within-group comparison across the various 
periods occurred within the CATTS Scope Feedback Group (p <,01), This 
significant simple effects analysis was further analyzed using Tukey and 
Scheffe post hoc analytic procedures , The analysis indicated that the CATTS 
Scope Feedback Group significantly reduced their mean percentage of pupil 
no-responses to teacher questions between baseline and the two treatment 
periods (p<.05). As indicated in Table 10, the CATTS Scope FeedK^ck Group 
also reduced their mean percentage of pupil no-responses during the maintenance 
period, although the reduction was not significant (p>,05), 

The final tutor variable that analysis was performed on was the percent 
appropriate matches, which included the times the tutor asked any questions in 
the TPQR hierarchy and the pupil responded at the same level. It was k;x- 
pected that there would be a significant relationship between the type and 
cognitive level of questions asked by the tutor, and the type and level. of 
responses given by the pupils. It should be recalled that. the previously 



Table 11. Analysis of variance table for percent pupil no-responses to teacher questions 



Source 



SS 



df 



MS 



Between Subjects 


. 2923.87 


Groups (G) 


556.85 


BetwecTi G at Pi 


51.75 


Between G at P2 


295.54 


Between G at P3 


243.49 


Between G at P4 


359.46 


Within Cell 




Subj. w. groups S (G) 


2906.26 



20 






2 


:"'8.42 


1.72 


2 


25.88 


<1 


2 


147.77 


2.h3 


2 


121.75 


2.00 


2 


179.73 


2.95 


72 


60.91 




18 


161.46 





Within S»ibject5 8797.05 

Periods (P) 233.97 

Between P at Gi 189.21 

Between? at G2 39.10 

Between P at G3 399.05 

GP ■ 39X37 

P X subj. w. groups SP (G) 1479.61 



63 
3 
3 
3 
3 
6 

54 



77.99 
63.07 
19.55 

133.02 
65.56 
27.40,. 



2.85* 

2.30 



<1 



4.86** 
2.39* 



Total 



11720.92 



83 



*p<.OS 

K.oi 
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Figure 6. Mean percent of pupil no-responses across the -nur teaching periods for 
o . three feedback groups (GP interaction). 
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described correlational analysis found a significantly high positive rela- 
tionship between teacher high-level questions and pupil high-level responses 
Cr = .944) fov the total tutor sanrple across all teaching periods. Table 
12 gives the mean percent of appropriate question-response matches across 
each of the four tea^..ing periods for each of the three feedback groups. 
Table 13 contains the analyses of vari?^?^^^source table for percent of appro- 
priate question-response matches. F ratios indicated no significant find- 
ings on the main or interaction effects Cp > .05). This finding is not 
surprising when one examines the meaiiS in Table 12. As shown in Table 12, 
the percentage of appropriate question-response matches v." o at least 95% or 
better for each of the three feedback groups across each of the four periods. 
Hence, each group revealed a high degree of correspondence between the type 
and level of question asked ard the type and level of pupil response. The 
lowest percent of appropriate question-response matches was revealed by the 
Supervisor/ Feedback Group during the first treatment period (i.e., 95.7% 
during P2) . A furthc^-- correlational analysis for each feedback group across 
the four teaching periods verified the strong relationship between the cogni- 
tive level of the tutors question and the pupils response. Pearson correla- 
tion coefficients betv; • ^ high-level questions and pupil high-level responses 
across the 4 periods Ww-rc? respectively ^.i^Qp^ = -955, ^^j^^^Q ^ .947, 

r . = .926. All three correlation coefficients were significant at 

supervisory 

the .001 level. 

As mentioned previously, in additit ii to the main source of daily teacher- 
pupil observational datr. collected during the project, data were also collected 
from several other sources. One source of data included a fifteen-item 
questionnaire given to the tutors at the end of their practicum {See 
Appendix Q.}. This questionnaire askod the tutors to evaluate on a six-point 
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MEAN- PERCENT PERFORJ-IASCH 





Pi 

Baseline 


Pi 

Treatrae'^t 1 


P3 

Treatment 2 


1 p:; ~ 

Maintenance 


CATTS DELAYED 
FEEDBACK GROUP 


99.14 


99.26 


99.61 


99.50 


SUPERVISORY 
FEEDBACK GROUP 
(G2) 


98.86 


95.72 


98.49 


98.50 


CATTS INSTANTANEOUS 
SCOPE FEEDBACK 
r.ROUP CG3) 


96.81 


99.43 


99.64 


99.00 


Total X 


98.27 


98.14 


99.^5 


99.00 



Table 12. Mean percent of appropriate question-response matches 
across the four teaching periods for each of the three 
feedback groups. 
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Source SS df MS F 

Between Subjects 138.99 20 

Groups (G) 31.08 2 15.54 2.59 

Subj. w. groups S (G) 107.91 18 6.00 

Within Subjects 503.78 63 

Periods (P) 18.65 3 6.22 <1 

GP 62.73 6 10.45 1.34 

P X Subj. w. groups SP (G) 422.40 54 7.82 

Total 642.77 83 



►p<.05 
►p<.01 



Table 13. Analysis of variance task for percent of appropriate question- 
response matches. 
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sclae their opinions concerning various aspects of the prc.cticin: experience. 
As indicated in Appendix Q, the following opinions wt^-re expressed. The 
questionnaire was completed by ail of the 21 tutor' In the project. As 
expected, 9S% of the tutors found preparing lesson plans according to the 
forniat described previously as helpful in teaching their lessons. In 
addition, the special class teacher was seen as a valuable resource for the 
tutors in planning their lessons. All tutors were happy to receive feed- 
back on their lessons. Approxiinately 45% of the tutors indicated that their 
particular form of feedback was most valuable. On the other hand, 24% of 
the tutors did not value their feedback and expressed a desire to have 
another type of feedback in addition to, or instead of the feedba.:k they 
received. Many tutors expressed an interest in receiving both t>'pes of 
CATTS feedback nodes. Of those receiving inmediate Scope Feedback, only 24% 
felt the scope to be distracting during the lesson, whereas 38% disagreed 
with this opinion. The majority of the tutors (62%) revealed that they 
found that daily graphing of specific categories off their printouts during 
the treatment pahse helped them see trends in pupil performance. Only 10% 
of the tutors disagreed with this opinion. Of those tutors who received 
Supervisory Feedback, only 48% expressed that their feedback was useful. 

One of the major criteria of the project was to increase amounts of 
higher-level teacher questioning over baseline rates. The teacher question- 
naire revealed that the large majority (71%) of the tutors felt the criterion 
of asking high-level questions improved their lessons during the treatment 
phase of the project. Some of the usbjective comments expressed by the 
tutors in relationship to thi: criteria included the following: * king more 
hi^^her-ordev questions seemed to; (a) increase the length of reply to 
Questions, (b) increase curiosity as measured by numbers of questions chii* 



dren asked abou^j substaiitive issues, (c) i.icrease complexity of grainmatir-ai 
structures used. ..e.g. ph^-ases and sentences used "ather than isolated words; 
cc2!plex rather than sinpie sentences, (d) increase attention span and time 
spent in on-task behavior, and (e) increase longer ?.nd more involved explanations 
in response to questions. In general, the large majority of tutors (91%) in- 
dicated that the practicum experience increased their confidence aiS perspective 
teachers and, was a relevant leamirtg experience for their teaching career 
(95%) . 

At the end of the project, the staff interviewed each of the eleven 
pupils and asked them questions concerning their feelings towards their own 
tutor and the practicum (see Appendix R) . Results showed that all the 
pupils enjoyed their tutoring sessions and liked their tutors. In addition, 
all pupils were given posttests on the same six standarc^ zed reading :*nd 
achievement tests given before the practicum began (see Appendix H), As 
indicated in Appendix H, the majority of pupils inade significant gains in 
reading-related measures, particularly in readii.g comprehension. In the 
Survey of Primary Reading, the greatest gains were on the Sentence Comprehen- 
sion and Story Comprehension subtasks. On the Wide .lange Achievement Test, 
the average gain for the total group of 11 pupils on the reading subtest was 
3.5 months (range 0 to 8 moriths). On the Gates-MacGintie reading test, 
the average gains on the Vocabulary and Comprehension subtests were 3.4 
(range 0 to 9 months) and 2,6 (range 2 to 8 months) months respectively. 
The average gain on the Dolch 220 Word List, was 28.1 words (range 8-S2) 
or 12.8%, 

The next source of data was based on an evaluation of three videotaped 
lessons taught by each trainee across the three teaching phases of the pro- 
ject (baseline, treatment, maintenance). As mentioned previously, the three 
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videotapct' lessons '.^f each tutor ir.cluded the last feedback lesson and the 
last aaintenance lessc : after the treatnierir or feedback phase cf the pnoject. 
The thr^e lessons were rated using thf=^ sign obser/ation sv-jtem developed by 
Lynch and Everton (Appe::dix N) . This system jr.easures the amount of elabor- 
ation of the child's response to a teacher's question, and it was used to deter- 
nine if any qualitative cnanges took place over the duration of the tutoring 
experience. The system contains eight categories. The frequency of pupil 
responses within each of the eight categories was calculated across the 
three lessons videotaped in each of the baseline, treatment and maintenance 
phases. The frequencies were then divided by the time (in minutes] within 
each lesson in order to get a .measure of rate of pupil responses within 
each of the eight categories. 

A repeated n^'^asure? A.\WA design was used to analyze the pupil data. 
Each of the eight dependent measures on the sign system was analyzed using 
an ANOVA design with one between factor, Feedback Groups [G] , and one within 
block factor, Periods (P) • The rate of each of the eight dependent measures 
across each of the three . Ul i lessors was utili::ed in the analysis. 

Of the eight ANOVA* s calculated, only three revealed significant findings: 
(a) one word utterances, (b) sentence fragments, and (c) complex statements to 
teacher questions. Ail three ANOV'A's involving these dependent measures indicated 
significant F ratios in the period (P) main effect (p<.05). None of the group 
(G) main effects or interactive [G x P] effects were significant {p'^.05). 
'ine finding is not surprising when one considers the projects were randomized 
across the three treatment groups. Hence, some pupils were tutored by trainees 
who received different types of feedback. In addition, tutors did net teach 
standardized i ossons during the three videotaped lessons. Hence, the lesson 
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content varied across tutors and was a possible source of confounding in 
terns of UTiifom group effect:-. Table 14 provides the nean rate of pupil 
perfomance date on each of the three dependent measures. TuVey post hoc 
analyses on the significant period nieans indicated that the eleven pupils 
as a total group significantly reduced their inean rate of o/'? word utterances 
between the last trials of t*- -? baseline a.vJ treatment periods (p < .05). 
In addition, the pupil sar.ple reduced their nean rate of sentence fragments 
(i.r. , T-esponses v^hich were nore than one word, but not a complete sentence) 
between the last trials of the treatment and maintenance periods (p < ,05), 
Or: the other hand, the pupil ScU^ple increased their mean rate of complex 
stater.ents between the last trials of the baseline and treatment periods 
(p < .05) and between the baseline and maintenance periods. Complex state- 
ments were defined in this context as the most complex and mature forms of 
oral expression '^tiich were recognised by the jresence of dependent clauses 
that followed or sometimes preceded the main clause of a sentence. Accord- 
ing to LvTich and Everton (1976), these sentences represented a qualification 
modification, or relationship^ rather than just several ideas linked together 
as in compound statements or ^'strings.*' No other pupil effects were found 
to be significant. ^ 

final source of data was based on a daily inspection of lesson 

This inspection revealed that, ^urirg the baseline period, tutors 
asked predominantel v low-level questions. Of the two types of low-level 

/ 

qu^»stions on the TPQR observation system., discrimination questions were/ 
asked the most, while recall questions were asked the least. During 
treatment phase, tutors in general asked questions from each of the six 
categories on the i PQR systeiii. Of the four ^ypes of hifeh-level questions, 
the order in frequency of usago of high-level questions from most to least 
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MEAN RATE PERFORH\NCE 





HE.AN RATE 
ONE fflRD UTTERANCES 


m RATE 
SEVTENCE FRAMS 


MEAN RATE 
COHPLEX STATBlihTS 




BASELINE 


TREATTfENT 


!iAINTENANCE 


BASELINE 


TREATMENT 


MAINTENANCE 


BASELINE 


TREATMEJfT 




CATTS DELAYED 
FEEDBACK GROUP 


0.164 


0.078 


0.152 


0.195 


0.158 


0.153 


0.005 


0.017 


0.014 


SUPERVISORY FEED- 
BACK GROUP 


• 0.126 


0.118 


0.097 


0.175 


0.220 


0.163 


0.006 


0.023 


0.019 


CATTS INST,mNEOUS 
FEEDBACK GROUP 
(Gj) 


o.r/1 


0.117 


0.125 


0.207 : 


0.203 


0.142 


0.007 


0.013 


r 
0.013 


TOTAL X 


0.154 


0.104 


0.125 


0.192 


0.194 


0.1S3 


0.006 


0.017 


0.015 



Table 14. Mean rate of pupil performance on the thr^e significant dependent measures 
of the sign system across each of the three teaching phases. 
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frequent was Sequencing/ Paraphrasing, Inference, Hierarchically Relating 
and Problem Solving. A random sainple of 25 lesson printouts from each of the 
three feedback groups during the treatment periods indicated that the CATTS 
Instantaneous Scope Feedback Group elicited the greatest variety of both 
high-and low-level questions and pupil responses in terms of percentages of 
questions asked and appropriate pupil responses. In addition, the Scope 
Feedback Group had the highest number of lesson profiles (18) where all 
six questions in the question hierarchical 5equence were asked and appro- 
priate responses were given. The CATTS Video and Supervisory Feedback Groups 
had 11 and 3 lesson profiles in their sample, where all six questions in the 
TPQR hierarchy occurred during the lesson. Hence, the CATTS Instantaneous 
Feedback Group was most successful in meeting the objective of progressing 
teacher questioning up the TPQR observation system hierarchy during the 
feedback phase of the project. 
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CR^PTER V 
SUMKARY AKD CONCLUSIONS 

Smnmary 

Objectives : (1) To determine the effectiveness of a Computer- Ass is ted 
Teacher Training System CCATTS) as contrasted with verbal supervisory feedback 
in the development of critical reading and listening comprehension teaching 
strategies of pre service special education teacher trainees in a tutorial 
(laboratory) setting. (2) To test the effectiveness of reading comprehension 
instructional strategies developed out of a psycholinguistic view of the lan- 
guage process in use with retarded learners in a special classroom setting. 

Perspective : Hie project described in the present paper attempted to 
relate the psycholinguistic processes of handicapped children to the training 
needs of special education teachers through the innovative application of 
CATTS technology in competency-based teacher training. The application of 
extensive research and inquiry into (a) a psycholinguistic approach to reading 
and language skills, {h^ organizational language, and cognitive strategies of 
retarded and disadvantaged children, (c) specific instructional methods to 
facilitate reading of retarded and learning disabled childien and (d) compe- 
tency-based teacher education provided the theoretical framework for the 
present investigation. The Computer-Assisted Teacher Training System (CATTS) 
served as the prime vehicle for the discrimination, generation and evaluation 
of specific teaching strategies in reading comprehension by pre service special 
education trainees. The project built on previous developmental work 
involving CATIS at the Center for Innovation in Teach: -.is; the Handicapped, 
Indiana University. 

Methods : In add rH study entailed five majrr* p.,u^rH^r' 'st, the develop 
ment of a cat' ^'o^ 'b^.-^^•'l^'ac- on-coding instrument "^'^-v-H^iit.li&ll) ^' -oasured 

hie'/i^rcJv wgrUtivo demands in the t^: ^^''^ teacher 
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questions during reading and iistening coinprehension instruction; second, the 
training of coders on the observation syste:?. using a computerized consensus- 
coding system, DITRMA, and the attainment rf raiiabie criterion intercoder 
and intracoder measures of observer agreenert; third, baseline observations 
(nine to fourteen) of trainee hierarchical questioning behavior and pupil 
responses during tutoring . lesson? in a laboratory classroozy setting; fourth, 
measuraznent of trainee questioning skills and pupil responses under three 
feedback conditions, (a) CATTS Instantaneous Scope Feedback, (b) CATTS 
Delayec Video Feedback, and (c) Super^'isory Feedback; fifth, observations of 
trainee maintenance of hierarchical questioning behavior and pupil responses 
during tutor lessons without feedback - 

In each of the three teaching phases 21 preservice trainees tutored 
eleven educable mentally retarded (EMR) children in reading instruction using 
diagnostic teaching lessons they had prepared- Trainees taught two SO-minute 
lessons with the sane child each week. Coders were randomly assigned to 
teachers such that each teacher was observed by a different coder each time. 
Coders coded teacher-pupil interaction on botton boxes which were hooked up 
to a ?uP'l2 computer located in a separate building from the laboratory 
classroom. 

In the baseline condition, trainees taught the lessons they had prepared 
without receiving feedback of any kind. The number of lessons taught during 
baseliiie varied from nine up to the first fourteen lessons taught. After 
their baseline trials were completed, the trainees were provided with a graph 
which sumjnarized their high-level questions and pupil high-level responses 
over the baseline period. They received modules which described the Teacher- 
Pupil Question Respcnsfj (TPQR) System and the GATTS System, The 21 trainees 
were then randomly assigned into the three feedback groups. Trainees assigned 
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to CATTS Instantaneous and Delayed Video Groups also received ri^odules which 
described the interpretation of printout feedback they would receive with 



either the Scope or Video Feedbac 



k conditions. 



Once feedback lessons began. 



those trainees who had CATTS Scope or Video Feedback received computer 



printouts in addition to their feedback mode which suinnaiized the teacher- 
pupil hierarchical questions and responses during the lessons. The trainees 
who had Supervisory Feedback received their first printout after their fourth 
supervised lesson. 

Four major objectives were stressed to each tutor. They included-; (a) 
increase amounts of higher-ievel teacher questioning, (b) increase amounts of 
appropriate pupil responses, (c) teacher questioning rate should be 30-50% of 
all teacher verbal interaction, and (d) progress teacher questioning up the 
TPQR observation system hierarchy. During the feedback phase, the bi-weekly 
lessons continued as during baseline and, in addition, all trainees received 
printouts on their latest lesson within 10 minutes after the lesH.;n. The 
tutors evaluated the printouts in conjunction with the four basic ;:cals for 
the practicum and graphed specific categories off their printout paper* 

Those trainees receiving CATTS Scope Feedback always had a video monitor 
in front of them which displayed the frequency of occurrence of t.he six types 
of questions on the TPQlR system that the teacher asked up to any giwcn moment 
during the lesson, as well as the percent of teacher questions aisked it any point ir 
time during the J' ssctt Five scope also displayed a moving arrow uthic± rhowed 
the indicated .cci*.^Tnitive : el at which questioning was occurrini^ 

Those tra:ii:iee5 r^>cer.'i ng Supervisory Feedback received suh jeet i 3 feed- 
back based or titie " .:..ils for the practicum in which both 1-- r;nt 
and appropriii ter is discussed. After their fourth feed!^^ trainees 
received the (jrln^ui. -rudback as well as supervisory evaluation total 
feedback ase c i tht -^r^ject variegl^^between ten and twelve lesson 
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Following the feedba-k phase of the practica-n, all trainees entered a 
maintenance phase for their final two or three lessons. This phase was identi- 
cal to the baseline phase of the project in that trainees tutored their child 
without receiving feadbacx on their lessons. Each tutor had at least three 
lessons videotaped including a baseline lesson innnediately before feedback was 
begun, th5 lasl feedback lesson, and the last naintanance lesson after feedback 
was terainated. 

Data Sources : 'xTie mp.in source of data for the project was based on 
the daily otservatioaaX data on th^ TPQR category-coding system. Data was 
colli5Cted on several dependent measures including: Ca) the percent of teacher 
questions, (b) the percent of high-level teacher questions over the total questions 
asked, (c) the percent of high-level pupil responses given, (d) the percent of 
pupil no responses over the total responses given, and (e) the ^ ^rc orl o-f appro- 
priate TTiatches, which included the times the teacher asked an; :-i.:;t .n the" 
APQ- nicrrrchy and the pupil responded at the same level. A:*u;v . ^ona:J. hE.-a 
wer^ :j; (L-e^cted from the following source*: Ca) a questionnai-ri give-.n tr 
the ^Tai. '^'ses at the end of their practicuui, (h) an interview ryiven t.: 'tiro EMR 
pjispL. :) pupil pre- and posttest results on several standsa"ddzed rrei^jing 
lerits achievement tests, and Cd) ratings of video-taped seasons om sn 

X • vc rating scale to determine if there were any other :rricurren-.t qualitative^ 

IstL-. t^ffects of asking children high-level questions. 

j^^esuir?: In general, the results revealed that tutors made significant 
riernjgti^s between: the Baseline and Treatment periods and maintained their changes 
.V. qi^estioniing behavior during the Maintenance period. In addition, tiiere 
weT^5^ aiifferen)tial changes as a function of the type of feedback received. 
Tht n.rst dependent variable analyzed was the percent of teacher questions 
dur^lng each lesson. The results indicated that tutors in each group achieved 
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the objective of keeping their questioning rate between 30-50% of all their 
verbal interaction once they received feedback. Before receiving feedback, 
the tutors dominated the interactions, with teacher questions averaging 85% 
of teacher behavior. However, as soon as the tutors began to receive feedback 
during the treatment lessons, they managed, as a group, to significantly 
reduce their questioning rate to 49.9% during the four fKP^ciback trials of 
the first treatment phase and to 47.7% a. .ring tthe seconc '^treatmen'*: phase, 
which varied between six and eight lessors. Moreover the uota, rutor ssinn?^^ 
maintained their questioning rate during the ;;a,:r.teaa: ce r. : -^^le^dhac 
phiiise at 47,9%. 

Vi\e results further indicated th^ir: , adt vourgh tne :*re : graiirpr Md Tiot 
d'if . :>:ignif icanitly during baseline, oain ter aiLce ar.' tir: '^rst trojutiv^emt 
r od . :hey did differ significantly during xlie secc. J i longer ant 
ner V'd. It could be argued that ai few feedback rriai a required ^ ;'':Te 
a !ra : cular feedback mode makes its most powerful iir^act In temiis cf 
inrr Liyxng pre service teacher behsLvior. At amy rate, thr ansilyses re : aled 
th?' thiB CATTS Delayed Video Feedback Group did not ciffer from the lA'lTS 
Instantaneous Scope Feedbrick Group during the second treatmient phase, but 
did differ significantly in their mean percent of total reacher questions 
from the Supervisory Feedback Group. It should be recalled th5*t all th-:ce 
feedback groups received objective printouts which sumjRarized their inter- 
actions on the TPQR category system. Hence, the Delayed Ideo Feedback Group 
was more effective than the Supervisory Feedback Group during the Second 
treatment period. On the other hand, the superiority in terms of total 
questions asked did not carryover into the maintenance phase. Perhaps if 
the second treatment phase had been extended, the superiority would have 
generalized into the maintenance phase. 
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The second dependent variable analyzed was the percent of teacher high- 
level questions over the total questions asked during each lesson. The 
results indicated that tutors in all groups achieved the objective of 
significantly increasing their percentage of teacher high-level questions 
as seasured by th^ -^T^vi; : .bservation system S^-tween the bcL5eli;:]e and initial 
treatment periodic. . Monrecvv^-^v, this propornioPc i increase in -jeircentage of 
high-level question .ncreased and crar: ::ed over into the maintenance 

period. The meam perc-enta^^:- jf teacher hi^,h- level questions across the four 
successive teaching r iods ^ v:is 15»6%, 28,. . ,nd 35.1%. Tr- results 
further revealed a tr^^vd toward greater meian: increases ..n hr ni level ques- 
tioning between basar *e and treatment periods fur the CATT5 Deilayed Video 
feedback group. i. - other hand, the SupiCT\ri3ory Feedback Gxraup demon- 
strated the lowes* pc^ce:ntage of high-level o.i :-5tioning across the two 
treatment periods v&.S". ai:d 25.0%). 

The third maj,:: dependent variable analysed was the percent of pupil high- 
level responses ovar the total pupil respomses to teacher questions during 
each lesson. The results indicated that tutors in all groups again achieved 
the critical objective of significantly increasing their percentage of pupil 
high-level responses as measured by the TPQR observation system between the 
baseline and treatment periods. In addition, this proportional increase in 
percentage of high-level pupil response (114%) increased in the second treatment 
period and carried over in the maintenance period. The mean percentage of 
high-level responses across the four successive teaching periods was 11.0%, 23.5%, 
27.5%, 26.0%, The results further indicated that, although the three groups did 
not differ significantly during baseline, maintenance and the first treatment 
period, they did differ significantly during the second and longer treatntent 
period in terms of the rate of pupil high-level responses. 
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The analyses re%-ealed that the CATTS Delayed Video Feedback Group 
elicited a significantly greater mean percentage of pupil high-level responses 
(37.5%) during the second treatnent period when conpared to the CATTS 
Instantaneous Scope (26.4%) and Supervisor:/ (18.5% FeedDack Groups. The 
difference during the same treatnent period betweei. the two latter feedback 
groups was not significant. However, further analyses revealed that the CATTS 
Video and Scope Feedback Groups together elicited a significantly greater 
mean percentage of pupil high-level responses than the Supervisory Feedback 
Group. For the CATTS Video and Scope Feedback Groups the analyses also 
showed that each group significantly increased their mean percentage of 
pupil high-level responses between baseline and the two treatment periods. 
However, the increase in percentage of high-level responses for the Super- 
visory Feedback Group between baseline and each of the two treatment periods 
was not significant. It appears that the addition of objective printouts, 
which suimnarized teacher-pupil question-response interactions on the TPQR 
observation system, did not add significantly to the subjective feedback 
provided by the project graduate supervisors. On the other hand, the initial 
significant effect of objective feedback, either instantaneous or delayed, 
carried over into the second and longer treatment period. It is noteworthy 
that all three feedback groups demonstrated no further significant changes 
during the maintenance period when feedback was removed. Hence, the 
effects that were developed during the treatment periods generalized into the 
final maintenance period for each feedback group. 

It should also be noted that daily inspection of the lesson printouts 
revealed that tutors in general asked questions from oach of the six categories 
on the TPQR observation system. Of the four typo.«; of high-level questions on 
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the systea, tae order in frequency of usage of high-ievei questions fron 
most to least frequent was Sequencing/Paraphrasing, Inference, Hierarchically 
Relating and Problexa Solving. Of the two tN-pes of low-level questions on the 
TPQR systea. Discriiaination questions were. asked the SKDSt, while Recall 
questions were asked the least. A randon sample of 25 lesson printouts from 
each of the three groups during the treatment periods of the project 
indicated thAt the CATTS Instantaneous Scope ..Feedback Group elicited the 
greatest variety of both high-and lew-level questions and pupil responses 
in terras of percentages of questions asked and pupil responses. In addition, 
the Scope Feedback Group had the highest number of lesson profiles where 
all six questions in the TPQR hierarchical sequence were asked and appropriate 
responses were given. On the other hand, the Supervisory Feedback Group had the 
-least variety of both high-and low-level questions and pupil responses, and 
the least number of lesson profiles where all six questions in the TPQR 
hierarchy were completed in sequence. Hence, the CATTS Instantaneous Feedback 
Group was most successful in meeting the objective of progressing teacher 
questioninf^ up the TPQR observation system hierarchy. This finding is not 
surprisir.g when one considers that this group always had a video monitor 
in front of them which displayed the frequency of the six types of questions 
on the TPQR system in terms of a bar graph as well as a moving arrow which 
showed the indicated cognitive level at which questioning was occurring. 
The CATTS Delayed Video Feedback Group was' able to immediately replay their 

lessons on videotape following their lessons. Together with the printout, 

I 

this experience allowed them to refresh their memories and visually process 

i 

the information on the printouts. On the other hand, the Supervisory 
Feedback Group had to rely on their supervisor's or their own long term 
memories in order to recall the sequence/ of questions asked during the 



Joe 



94 



lesson, particularly during the initial four trails of the first treatment 
period when they did not receive any objective sunnaary printouts. 

The fourth dependent variable analyzed was the percent of pupil no-responses 
to teacher questions asked during each lesson. TTie results revealed that 
the nean percent of pupil no-responses decreased slightly (approximately 17.5%) 
between baseline and treatment periods. The mean percentage of pupil no- 
responses across the four successive teaching periods was 18.9%, 16.7%, 
14.5%, and 15.4%. However, the three feedback groups did not differ signifi- 
cantly during the four periods of the project. The C^TTS Instantaneous 
Scope Group was the only feedback group who significantly reduced their 
mean percentage of pupil no-responses to teacher questions between baseline 
and the two treatment periods. Infact, there was a general trend for the 
Scope Group to gradually decrease their percentage of pupil no-responses 
into the maintenance period. The Supervisory Feedback Group elicited the 
highest percentage of pupil no-responses during the treatment and main- 
tenance periods. 

The fifth major dependent variable analyzed was the percent of appropriate 
question-response matches. This variable included the times the tutor asked 
any question in the TPQR hierarchy and the pupil responded ^t the same 
cognitive *level. In general, the results showed that there was an extremely 
high relationship between the type and cognitive level of questions asked by 
teachers and the type and level of responses given by the pupils. In fact, 
the mean percentagessof appropriate question-response matches across each of the 
four teaching periods were respectively 93.2%, 98.1%, 99.3% and 99%. Moreover, 
the percentage of appropriate matches was at least 95% or better for each of 
the three feedback groups across each of the four periods. The lowest 
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percent of appropriate matches was revealed by the Supervisory Feedback Group 
during the first treatment period (i.e., 95.7%. A correlational analysis also 
revealed a significantly high positive relationship (r = .944) between the per- 
cent of teacher high-level questions and pupil high-level responses for the 
total tutor sample across all four teaching periods. The percent of appropriate 
matches further verifies the strong relationships between the type and 
level of teacher questions and pupil responses. 

Another source of data included a questionnaire which asked tutors to 
evaluate their opinions of the practicum experience. The majority of tutors 
indicated that th© practicuni experience increased their confidence and was 
a relevant learning experience. All tutors were happy to receive feedback 
on their lessons, and approximately on-half indicated that their particular 
form of feedback and the daily printouts were most valuable. The majority 
of tutors also found that daily graphing on tho CATTS feedback condition of 
specific categories off their printouts helped them to see trends in pupil 
performance. Of those receiving Instantaneous Scope Feedback, less than 
one-quarter felt the scope to be distracting during the lesson. Of those 
tutors who received Supervisory Feedback, less than on-half expressed that 
their feedback was useful. The ifiajority of* tutors indicated that the criterion 
of maximizing high-level questions improved their l^^ssons during the treatment 
periods. The tutors said that they observed several concurrent effects as they 
began to ask more higher-order questions. Asking more higher-order questions 
resulted in an increase in the length of reply to questions; an increase in 
curiosity as measured by number of questions children asked about substantive 
issues; an increase in complexity of grammatical structures used; an increase 



in attention span and time spent in on-task behavior; and longer and more 
involved explanations in response to questions. Several of the tutors 
indicated that they were surprised and happy to see that their handicapped 
pupil was capable of responding appropriately to high-level questions^ 
Further research is required to document more specifically the possible 
concurrent effects of asking mildly handicapped children higher-order ques- 
tions, as well as the relationships among those concurrent effects. The 
specific content of the pupil's response should be investigated in terms of 
its semantic and syntactic components as we] 1 as a concept analysis of the 
pupils responses in terms of the content and the instructional task. 

In relationship to the eleven pupils in the project, results showed 
that all pupils enjoyed their tutoring sessions and liked their tutors. 
The majority of pupils made significant gains in reading-related standard- 
ized measures over the course of the project, particularly in reading com- 
prehension and sight vocabulary. A final source of data was based on an 
evaluation of three videotaped lessons obtained during. each tutor's last 
baseline, treatment and maintenance lessons. The lessons were rated using 
a sign observation system which measured the amount of elaboration of the 
pupil's response to a teacher's question, ^ The rate of pupil responses within 
each of eight categories on the sign system was calculated. Results indicated 
that the total pupil sample significantly reduced their mean rate of one- 
word utterances and sentence fragments between the last trials of the baseline 
and treatment periods. Moreover, the pupil sample increased their mean rate 
of complex statements between the last trails of the baseline and treatment 
periods and transfered this gain into the maintenance periods. Between 
feedback groups, comparisons were not significant on these same three pupil 
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variables. However, this finding is not surprising since the effect of 
feedback groups is confounded by the fact that pupils were randomized across 
treatment groups. As a result, some pupils were tutored by trainees who 
received different types of feedback. 
Conclusions : 

In conclusion, the present project has demonstrated the efficacy 
of CATTS Instantaneous Scope and Delayed Printout and Video Feedback as 
well as Supervisory Feedback in generating specific teacher behaviors in 
a pre service laboratory teaching setting. The project realized the stated 
objective of training critical patterns of teacher-pupil question-response 
interaction in reading and listening comprehension instruction with the aid 
of CATTS. The projcct^also showed the feasibility of implementing the CATTS 
system with preservice trainees as part of their preseryice teacher training 
program in special education. Mora specifically, the project demonstrated 
the relative effectiveness of CATTS Instantaneous and Delayed Feedback with 
supervisor verbal feedback in a laboratory tutorial classroom setting. In 
essence, the two CATTS feedback groups and in particular the CATTS Delayed 
Feedback Group performed most effectively during the project. In stunmary, 
the Delayed Video Feedback Group was more effective than the Supervisory 
feedback in keeping their questioning rate below. 50% of all verbal interaction 
during the treatment phase of the project. There were no differences between 
the two CATTS feedback groups or between the CATTS Instantaneous Scope and 
Supervisory Feedback Groups in relation to this particular dependent variable. 
Although the differences were not significanti there was a definite trend 
toward greater mean increases in high-level questioning between baseline and 
treatment periods for the CATTS Delayed Video Group. On the other hand, 
the Supervisory Feedback Group demonstrated the lowest percentage of high- 
level questioning across the treatment periods of the project. 




The most important finding was based on the percent pupil high-level 
responses to teacher questions during each lesson. The results demonstrated 
the superiority of the CATTS Delayed Video Feedback Group in eliciting 
pupil high-level responses during the second treatment period over both the 
CATTS Instantaneous and Supervisory Feedback Groups. Again, the differences 
between the CATTS Instantaneous Scope and Supervisory Feedback Group were 
not significant. However, the combined effects of the two CATTS feedback 
groups was superior to the Supervisory Feedback effect in eliciting a greater 
percentage of. pupil high-level responses to teacher questions. Moreover, 
the Supervisory Feedback Group, unlike the two CATTS groups^ was unable to 
increase the percentage of high-level respon.ces between baseline and both 
treatment periods. Even the addition of objective printout feedback did not 
significantly effect the rate of pupil high-level responses fbr the Super-" 
visory Feedback Group, For all feedback groups, any effects developed 
during Treatment periods generalized into the final no«feedback maintenance 
petiod. Of the three feedback groups, the CATTS, Instantaneous Feedback 
Group elicited the greatest variety of both high-and low-level questions 
asked and pupil responses given across a sample of treatment lessons , and 
the highest number of lesson profiles where all six questions in the 
Teacher-Pupil Question-Response category system were asked and appropriate 
responses were given during the leisson. On the other hand, the Supervisory 
Feedback Group elicited the least variety of both high-and • low-level questions 
and pupil responses, and were least successful in meeting the objective of 
progressing teacher questioning up the TPQR observation syistem hierarchy. 

The CATTS Instantaneous Scope Group was the only group who significantly 
reduced the mean percentage of pupil no-responses to teacher questions 
between baseline and the two treatment periods. On the other hand, there 




was a trend for the Supervisory Feedbnt;! '^roup to elicit the highest per- 
centage of pupil no-responses across the treatment and maintenance periods. 
The lowest percentage of cppropriate matches between the type and cognitive 
level of questj;ons asked and responses emitted were also elicited by the Super- 
visory Feedback Group, Subjective tutor ratings i.Tid£cated that trainees, 
in the Supervisory Feedback Group were least satis^le.L with their form of 
feedback. 

Based on the results, it may be generally i<7T:—iMi^<d that the 
CATTS Delayed Feedback Group was most effective ' iifying teacher and pupil 
interactive question-response perfomance. Althau,, the differences were 
not significant, there was a trend for the CATTS Insrantaneous Scope Feed- 
back Group to be more effective than the Supervisory Feedback Group in terms 
of their teacher-pupil question-response performance data. Furthermore, 
the combined effects of the two CATTS feedback modes were generally more 
effective in modifying teacher-pupil performance than the effects of Super- 
visory Feedback alone. Future research should investigate the relative 
teaching performance of trainees who receive both CATTS Scope and Delayed 
Video Feedback compared to trainees who receive only one form of CATTS 
feedback in the development of critical reading and listening comprehension 
teaching strategies, IN addition, the comparative effects of delayed 
CATTS Delayed Video Feedback with computer printouts should be investigated. 
Based on the findings in this project, it is difficult to determine if the 
superior effects of CATTS Delayed Video Feedback were due to th^ opportunity 
of trainees to replay their lessons on videotape, or to the combined effects 
of videotape review and objective printout feedback. 



The project wa3 also successful in developing a reliable observation- 
coding instrument for use in training preservice teachers in special educa- 
tion to discriminate among, generate and evaluate specitic teaching behaviors 
and patterns related to reading and listening comprehension instruction. 
The use of this instrument in other content-related instruction should be 
investigated. As tioned previously, further rese?;^ cfr required to 
document more spe^ ifi illy concurrent effects of askiiVf uldiy handicapped 
children high-level questions across specific lesson content. The present 
project has described a preservice application of C ITS, and has. demonstrated 
and supported the efficiency and efficacy of instantaneous and delayed CATTS 
feedback for training critical patterns of teacher interaction in reading 
and listening comprehension instruction in a controlled laboratory setting. 
Yet to be determined are the efficacy of the system and its uniqueness in 
training special and regular education preservice and inservice teachers to 
generate effective reading and listening comprehension teaching strategies 
in naturalistic classroom settings. In addition, the cost-effectiveness of 
CATTS as a training vehicle, in comparison to traditional preservice and 
inservice teacher training techniques in naturalistic classroom settings, 
is yet to bo determined. In essence, CATTS is a versatile and comprehensive 
deliver/'y system which can be applied in many ways within the field of teacher 
education. ith creative , applications, the system can be of great assistance 
in the accomplishment of training objectives for competency-or performance- 
based training programs in special and regular teacher education. . 
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T: "What's in thi?; T>icture?'^ 

St: "A boy and a girl/' 

St: "In what year did John Kennedy die?'* 

T: "I don't know." 

T: 'Put all the pictures of tools in one pile and all pictures of materials 
in another.-* 

St: (Does so.) 

St: "Can you guess what happens at the next page?" 
7: 'The boy falls down." 

St: 'Ifhat would happen if you left the meat on the table and the dog was 
loose in the roon?" 

T: Dog would eat the neat.'' 

T: "Can you explain how this letter is different from the other?" 

St: 'They're different.'^ 

T: 'Does your mother use baking powder in her cake?" 

St: "Yes." 

T: 'Tell me the story from the beginning to the end." 

St: (Does so.) 

St: "What would happen if it would snow for two weeks in a row?" 

T: 'We won't be able to go outside." 

T: "Are these two letters the sane?" 

St: "This is a p and the other is a q." 

St: "Do you think that the boy in the story chose the best way to solve his 
problem?" 

T: "Yes." 

T: "If you were lost in a big department story, what would you do?" 

St: "Look for a policeman." 

T- "What is this letter?" 

St: "B." 
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T: "What does the sentence on the flashcard say?" 

St: (Does so.) 

St: 'Did the boy lose his hat or did soneone take it?" 

T: '^He lost his hat/ 

St: "What wuld have happened if he'd attached the wheels to the car with 
a bolt? ^ 

T: 'They would fall off." 

St: "How would you fix a soapbox?" 

T: "I'll take wood, hanmer, etc." 

T: 'Hfhat could you do to help a friend havinj? trouble with her school work?" 

St: "If you have trouble with your schoolwork you get bad marks." 

T: "Would you rather write a story or read one?" 

St: "Read one," 

St: "What happened after the girl in the story had a fight ^ith her friend?'' 

T: "I once had a fight with my best friend." 

T:^ "How many letters in this word?" 

St: "Three." 

T: "Tell me the story in your own words," 

St: (No response.) 

Child begins throwing pencils. 

St: "What does happiness mean?" 

T: "Feeling groovy." 

T: "How many lines does this letter •A* have?" 

St: 'Three." 

St: "Can you think of other ways to ear money?" 

T: (Does so.) 

T: Read the sentence on this flash card, 

St: (Child reads.) 
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St: "I'll going to a baseball game tonight/' 

T: "So, Ll^ deal." 

T: 'Tell »e what happened before Johnny began fighting with Sue/' 

St: (Does so.) 

T: "Can you think of one word to describe all of the followinf apple, 
orange, fig, pear, banana?" 

St: "I bought some of those at the store yesterday." 

T: "Which color crayon do you want to use?" 

St: "Blue." 

T: "Can you put these sentences in order to tell a story." 

St: "I can't. ' 

Tt ''Do you have to use the bathrooa?*' 

St: Child gets up and leaves. 

T: "Read this word.*' 

St: "Hee, the weather is nice." 

St: "Who won the race?" 

T: "Joe." 

T: "Put all animals which fly in one pil^ and thsose tJiat a^-^^im in anothier." 

St: Does so. 

St: 'Have you ever used a hanmer?" 

T: "Yes." 

St: "What would you do if the chain of the swing broke?" 

T: "Fix it by bolting it together." 

St: "What do you think would happen if a little boy would try to drive a car?" 

T: "He would crash into a tree and smash it all up." 
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T: HoK are you tfv^ay? 

St! I Kuess all right. 

T: Let's start with this story--you read the first paragraph. 

St: (Does so.) 

T: What does the naragraph say? 

St: (Does so.) 

St: Can you inaj^ine what happens next? 

T: (Does so.) 

T: What do you see in this picture? 

St : (Answers . ) 

T: Now. would you like to read the rest by yourself, or would you like to 

read it out loud? 

St: I»ll read it by myself. 

St: How would you fix . Fiat r --e'* 

T: Patch it with liqrjid Tubhe-- 

St: What is Halloween'' 

T: It's a holiday and vou dre? " up in coptuner . 

St: What happened to the -old lfj:r^' in the stOTry'' 

T: She broke her haclr. 

T: Explain to me everythin<?. thnr hapnened before fhe boy attacked the girl 

St: The girl called hiir^ names. 

T: How can ve prevent a fire from starting in the house? 

St: Don't overlbud ele^ctrlcal w-lres. 

St: Why do you think the plane crashed? 

T: It must have run out of gas. 

St: What would happen if rugs were made out of ice? 

T: Everyone would get cold feet and slip. 

T: Look at this word, how many letters are there? 

St: Three. 

T: Look at the ceiling; is it the same color as the picture in the book? 

St: I don't know. 

St: What does the word solvent mean? 

T: I don't know. 

St: Can you think of one way to get out of a locked room? 
T: . Well, you could scream for help. 

St: How many eyes does the monster have in this picture? 

T: Sixteen. 
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St: Why are cars and busses alike? 

T: Because they both are used for transnortation. 

T: What would happen if a tree fell in the street? 

St: It would block traffic. 

. T: There are 5 pictures. Can you nut then in order so they tell a story? 

St: (Does so.) 

St: Where did the j^irl in the storv go? 

T: I'm goinj; on a trip tof»rTcw: We are eoinj? sailinj^I 

T: What is this letter? 

St: A "L' . 

St: Who entered the big castle the very last? 

T: I think it was the robber. 

T: Who found the treasure first? 

St: Mary found it first, and right after her John found the right place. 

T: How are these letters alike? 

St: They are different. 

T: What is thii letter? 

St: a "0'^ 

Student falls asleep. 

St: What happened to the mother in the storv? 

T: She becaroe 5ick--iny mother was sick last week. 

St: What happened to the children after the mother went to the hospital? 

T: When my motf\er went to the hospital, we stayed with my uncle. 

St: How would you get that kite out of that tree? 

T: My kite was in a tree once. 

T: How wuld you get that kite out of that tree? 

St: If you fly your kite when it is very windy it could get stuck in a tree. 

T: How would you get that kite out of that tree? 

St: I'll borrow a ladder, climb up, and very carefully put the kite loose, 
because if I would tear it, I could not use it anymore. 

St: How would you find your way home if you were lost? 

T: I'd look for a policeman. 

St: How is a coat and a dress alike? 

T: They're both made of cloth. 

T: Did you like the lesson? 

St: I'm going home. 
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T: WhAt ytoxxld you drink if vou were stranded on a desert island? 

St: Sea water. 

T: Sea water drys out your cells, what else would you try? 

St: I dcn't know, what would you do? 

T: I'd eat leaves, roots and fruits. 

T: Have you ever build a soap box car like the one in the story? 

St: I built a treehouse once. 

St: What was the first thing vou did this mcming? 

T: Brushed ^ teeth. 

T: What will happen if I put the paner into the fire? 

St: The paper will bum and you will ^et ashes. 

St: How do you spell dog? 

T: D-O-n 

T: What would you do if you got lost coining hone from school? 

St: I would look for a policeman. 

St: What do tigers look like? 

T: They are big yellow cats with black stripes. 

T; Can you ptit these pictures in order so that they tell a story. 

St: This pictures cones first because the girl is getting out of bed: 
after that she puts on her shoes. 

ff 

T: What makes bread rise? 

St: I think ny mother uses yeast. 

T: How are cats and dogs different? 

St: Cats meow and dogs bark. 

T: What would happen if it snowed for two months? 

St: We would make snowmen. 

St: Is this an "A'» or a *'C"? 

' T: An "A". 

Tr What would you do if your friend fell down the stairs and got hurt? 

St: I*d call a doctor. 

T: Did the boy in the story go to school or play hookey? 

St: Play hookey. 

T: What happened first in the story? 

St: The dragon was crying. 

St: Why does it rain? 

T: Because water builds up in the clouds until they can't hold it anymore. 

T: Why do you think Sam hit John? 

St: John stole Sam's truck. 
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St: How are these letters alike (T, I)? 

T: Both have one vertical line, 

T: Are these two letters different? 

St : No they are both T ' s • 5 

St: What color is my pencil? 

T: Yellow, 

T: What woujd you do if your pencil broke during a test? 

St: Ask my neighbor for one, 

St: Did you like school when you were in the first grade? 

Tt No, 

St: How would you start a fire without matches? 

T: Rub two sticks together, 

T: Wnere do snakes live? 

St: In the ground. 

St: Put these pictures in order so they tell a story, 

T: (Does so,) 

T: What do you think Joan will do with her soapbox car after she is 

finished with it? 

St: Maybe she'll give it to me.-^"^ 

St: How would you find out what to feed s: unicorn? 

T: I*d look it up in the encyclopedia under unicorn, 

T: What will hev mother say when she finds out Susie can read the ''dog book"? 

St: She will say she is proud of Susie, 

T: Can you tell me a story about this picture? 

St: Once upon a time there was a little girl who lived in a castle and she 
was unhappy because she had no one to play with, 

St: How do you get to your house? 

T: Go over the river and through the woods and its the fourth treehouse 
on the left, 

St: What will happen if Carol doesn't go to school today? 

T: I will mark her absent and she will miss the new lesson, 

T: Summarise the story you just read, 

St: The story is about John, who lost his hat on the way to school and 
had to find a way to get a new one, 

St* How is television different from radio? 

T: Television has a picture and radio doesn't, 

T: Which of these words is carrot? 

St: That one, 

St: Put all the A's in one pile and all the Z's in another, 

T: (Does so,) l3G 
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St: What would you do if the lights went out in your house? 

T: Look for candles and matches. 

T: How are horses, cows, dogs, cats and whales alike? 

St: I don't know 

T: They are mairanals. 

St: What are mammals? 

T: Warm blooded animals that bear live babies. 

St: Why do you think your car didn't start this morning? 

T: I think the battery is dead. 

T: In the story did the lion and the tiger fight? 

St: No, they were just playing. 

T: I am going to say a word and you tell me the names of the first 2 letters 

'•Cat'* 

St: C-A 

St: What was the name of the girl in the story we read last week? 

T: Susie. 

T: What letter is this? (pointing to a letter) 

St: C 
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T: ' How are you today? 
St: I an fine, 

T: Let's continue our story of yesterday. Do you remember what the story 

was about? (Recall intonation), 
St: About a girl who asks a lot of questions, 

T: How did the story start? 

St: The girl took a ride with her family and started asking all kinds of 

questions about what she saw. She asked about the houses, the people, 
then they, , , 

St: Why do you think sh« would ask so many questions? 

T: Well, I think people ask questions because they see things they don't 
quite understand and they want to find out, 

St: Teacher, can you guess what happens on the next page? 

T: I think that the girl might to into the class and start asking questions 
to the students and the professor, 

St: What would you do if a little girl comes into your class asking everyone 
questions? 

T: r would make a place for her and let her ask questions! 

St: How do you spell the word ''question'*? 
T: question 

St: What is this word here? 
T: "professor" 

T: We just talked about what a university is--a place where people go to 

study things. Can you now guess what a professor means? 
St: Probably a teacher, like you are. 

T: Very good, very good, 

St: What is this in this picture? 

T: A dog, yes, a dog, 

T: Can you think of a reason why there would be a dog in this story? 

St: (Shrugs shoulder--no response). 

T: What do you think the people in this picture are doing? 

St: They are students listening to the teacher, 

St: rti, I see. I guess you are right. Do you remember whether the girl 

had a brother or sister? 

T: I believe the story said she had a brother and a sister. 

St: Do you remember the name of €he brother and the sister? 
T: If they had only 3 children then a small car, like a VW, would be big 
enough for rides. 
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St: Here is a picture. You are right. She has a brother and a sister. 

Can I go on reading? 
T: Sure. ' 

St: . . .The university was in a big building, like the airport. . . What 

does "university" mean. 
T: It is a place where people go to study things they want to find out more 

about . 

St: Is this the word "university"? 
T: Yes, 

St: Which student answered the question first? 
T: The dark haired boy. 

St: And who answered after that? 

T: I believe the person right behind him. 

(Student just looks through the books for one minute.) 

St: . Teacher, do you like this story? 

T: I think it is neat--5he is a bright girl, very inquisitive. 

St: How do you s^ell "inquisitive." • 

T: inquisitive ^ 

St: What would you do if you would want to learn a lot? 

T: Well, study by myself, use a library, find people who know more than I do 

T: Can you find a library building somewhere in this picture? 

St: Here is one, I think. 

\ . ' 

Student takes a crayon and starts coloring the picture. 

T: What did the boy in the story do for Christmas? 
St: He went to his father's house. 

T: What was the boy's present like in the story? 
St: It was big and colorful. 

T: How was the Christmas tree decorated? 

St: It has bulbs on it and colored balls and snow. 

T: What is a holiday? 

St: It^s a special day, when we celebrate something. 

St: How did they celebrate Christmas in this story? 

T: The whole family got together and spent the Christmas day at the fathers 
house. 

St: How many children were there In the family? 

St: One-two- three- -there are only three. 
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T: Would you tell the story in your own words? 

St: Well, first the boy went home, then he went to sleep. He woke up very 
early the next morning and went downstairs to look for his presents, 

T: How would you cut the tree down in the forest if you lost your saw? 

St: I'd look for an axe, or go and borrow a saw. 

St: How would you explain what Christmas means? 

T: Well, it is a Christian holiday, where we celebrate the birth of Christ. 

T: Why would people want to celebrate the birth of Christ? 

St: Probably because they think Christ was a very good person. 

St: What happened after the boy went to church? 

T: After he went tc church, he took a long walk Into the woods and thought 
about his life. 

T: What happened after the boy spoke to his priest? 

St: He decided to learn Zen. 

St: Why do you think we celebrate holidays? 

T: Because they're fun. and you get to see a lot of friends, and, let's see, 
well, I think people like to get together at times, 

T: Can you guess why Santa Claus is a weirdo? 

St: Because he cawe from Pittsburg? 

St: What kind of things happen, you think, if Christmas came in the summertime? 

T: I would decorate my rose bushes, and have a «ifimming pool Christmas partyl 

St: How would you keep kids from ripping off toys in the stores? 

T: Have policemen frisk them. 

St: What is an angel? 

*T: A spiritual being. 

T: How would you build a Christmas fire without matches? 

St: I'd use a Zippo light. 

T: Can you guess what would happen if Santa looked like Joe Nainath? 

St: Yeah, he'd wear panty hose. 

Tt Why do you think Santa chose to come down the chimney? 

St: Because it's the fastest way, 

T: Do you see a chimney? 

St: Here is one, 

T: What things could you do to surprise your family on Christmas? 

St: I would get up e^r^v and surprise them with a big breakfast and I could 
•^amake presents i everyone myself, 

T: How would you choose to hide the presents from everyone in your family? 

St: rd stick them in the basement, 

T: What do we mean by Christmas prayer? 

St: It's a way of sending a personal message to God, 
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St: How are prayer and meditation alike? 

T: They're both wasy of communicating with some sort of Hod. 

Sti What would you do to stop teachers from talking so much about Christmas? 

T: Start talking about something else, or bring in other things, or 
just tell them to stop talking about it! 

T: What is it that makes Christmas different from other holiday3? 

St: Christmas means Christ's birthday. 

St: How are decorations and presents alike? 

T: They're both things we have on holidays, and they make holidays fun. 

T: Tell me everything that happened before the holiday in the story. 

St: The car broke down and the people were held up so long that they were 
going to be too late so they went to a phone. . . 

St: Can you remember what the man's name was? 

T: Kris Kringle. 

T: What happened to the girl on the street corner? 

St: She got hit by a snowball, which really hurt her badly. 

T: How would you prevent the ornaments from breaking? 

St: I'd make a rulo that all kids keep their hands off and they only could 
look at them. 

St: What would happen if the Christmas tree was made of wood? 

T: It might start a fire. 

T: Put the cards in order so they tell a story about Hod. 

St: I can't. 

T: What is mistletoe? 

St: A type of plant we use on Christmas to decorate the house, it has little red 

T: What would happen if we eat hot dogs on Christmas? 

St: I don't know. 

T: What is holly? 

St: Holly is a plant, with sticky leaves, very pretty. 

T: What happened to Kris Kringle? 

St: Kris Kringle turned into Santa Claus. 

T: Tell tie the story of Christmas in your own words. 

St: One day, a long long time ago, Mary and Josef were going to have a baby. . . 

Child gets up - gets kleenex - blows nose - sits down 

T: How does Santa look in this picture? 

St: If Santa was Jewish, he would not eat pork. 
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St: Teacher, will you tell me the story .of the old n&n Scrooge? 

T: No', I don't want to now. 

St: Can you think of ways to change old man Scrooge's behavior? 

T: Well, we might try behavior modification! 

T: How would you prevent Scrooge from waking up at night? 

St: Rive him some sleeping pils, or a lot of wiskey. 

St : Teacher what finally happened to Tiny Tim? 

T: Scrooge game him a present and he was very happy. 

Stt Can you tell me what happened to Santa Claus before he left the North Pole? 

T: He slipped on the ice and got a hernia. 

, Child plays with objects on table. Teacher just watches. 

T: How many ornaments are on the tree? 

St: Six. 

St: Who opened the peanuts first? 

j T: The little boy opened the peanuts first. 



St: To pray and celebrate Christ's birthday people go to church for that reason. 

St: Teacher, what is this picture? 

T: That is a nativity scene. 

St: Teacher, what happened to Christ after he was bom? 

T: He lived with Mary and Joseph, and when he grew up he became a carpenter, 

St: How do you explain Christianity? 

T: It's a religious following, some believe that a lot of people live by. 

St: And what did the boy do in the story? 

T: He was a thief, I believe. 

St: What would happen if Santa lost 200 lbs. of his weight? 

T: He could slip through the chimney very fasti 



T: What color is Santa's beard in the picture? 

St: I White. 

T: iWhat are the shapes off the decorations in the picture? 

St: I don't know. 

Teacher and student begin to tidy up. 



T: 




church on Christmas. 



St: How can we save money for Christmas presents? 
T: I don't know. 
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Q: What is the difference between beige and brown? 

0: Do you think so? 

Q: What else would you do with it? 

0: What is this? 

R: I don't know. 

T: touches child's hair . . . 

R: *'Hair:'' 



Q: How does it sound? 

0: How do you know you are ri^;ht? 

0: How many words do we know now? 



The teacher gives the child sentences to read with difficul<t words in them 
which the child does not know. The child is told to think 'Vhat imkes sense' 
in attempting to "read'* the word. 
Ex.: I go to feed the dog in the snow. 



Q: What is the opposite of 'before'? 

0- Why did you say this word was Christmas? 

"Are you sure?" 

Math lessons: What is 2 and 2? 

Math problem: How would you find out if the answer is correct? 

0: Is this a fair trade - does the change you gave me plus the merchandise 
equals the money I gave you? 



Q: Then what happened anything else? 

Q: What book do you want to read next week? 
P: A Lassie book. 

Q: Do you Ynov what kind of vdog a Lassie dog is? 
0: Where is the 'it' (the 'it' is not there)? 

T: If you walk outside, then (child needs to fill something in, 

the intonation was like a Question sentence. 

Or You would not have anyone do that to you wovild you? 

0: Whv do vou wear gloves in the winter? 

14C 
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Child is adked to write in missinj? letters, 

Q: How would you explain what means? 

Q: Can you spell this word? 

R- 'Tes," 

Q: Do you know what the seasons are? 

0: What can you tell me about winter? --it has to be in one sentence 

Q: Now, is that a sentence? 

T: Tell me a sentence about Christmas. 

Problems 

1. If Questions are written out and the child reads the questions code the 

Question as If teacher asked. tnacher 

1,1. If questions are in a workbook and the child answers them silently , 

2. Filling in . . , when th^ intonation is a question-like intonation. 
Pointing • • • ''and this one../* mK'*^ttoning iTitrmation. 

Solution r If you t^rn ^aticali/ put a questic^nmark behind It? 

3. On or off th<^ less subject. 

4. Ifhen the teacher asks a question but does not provide opportunity for 

the child to respond. Instead the tutor goes r'ght on giving additional 
information and repeat the question in the same or slightly different form? 

4.1. Same as 4., but teacher now asks a totally different question. 

5. The child initially gives no response, then, unsuspected gives the right 

response after that. 

5.1. How long to wait for 'no response'. 

6. Wrong answers. 

7. Subtle differences between category 5 and 6. 



i-ic 



ERIC 



APPENDIX E 

Sample Forms, Schedules for CATTS Project 18 



147 



136 



K495 - Practtcum Dr. Sitko 



DATE: X - - 1C> 

SCHEDULED TIME: Q'.^S' - <^ 

TUTORS: Name Ge\mbeV- No. 00 



CHILD: Name T^riO. No. ^3 



CODER: Name tJ.f: No . .0^ Box N(5.. 

CODER: Naoe^ no. Box No.. 



STATION: (mark x) A B, 

C(M1ENIS: 



LESSON OBJECTIVE: 



n 
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BOOTS 



A. 



LESSON NO. %$C. 

PJPIL HO,. . ,Cp, 

CODES KO. 

TIME 
P2EDBACK 

SEM 



LESSON rm. 

TOTOR MO. 
PUPIL MO, 
CODER NO. 
TIME 
PEBDBACK 
SEN 



_i2> 



LESSON NO, 

wroR K0„ 1*7 

PUPIL NO. 
CODER NO, 
TIME 

FBEDB/CK 



NAi'U': 



yjOX DOWN 



NA 



PUPIL 



BOX. ly.^^ 
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Tu«sdaj 



8:45-9:15 

9:15-9:45 

9:45-10:15 

10:15-10:45 

10:45-11:15 

11:15-11:45 



Thursday 



11:00-11:30 
11:30-12:00 



Friday 



8:45-9:15 

9:15-9:45 

9:45-10:15 

10:15-10:45 

10:45-11:15 

11:15-11:45 



TwTOR SCHBDCLE - K495 SFRIW 19?6 

SECOND SEMESTER 

B 



G«abar-08 
{Dona 03) video 

Maggl*l3 D3 
(Mark 05) 8up«r 

Pawl Ik- 1 7 
(Sam 01) vldao 

Gallogly-06 _ _0t 
(Terry 04) super 

Newhouae -15 Ol- 
(Terry 04) video 

Gould-09 Q S 

(Sam 01) super 



Felnst«rm&k«r-05 05 
(Jim 10) video 

Felkel-04 : 0 2. 
(Dona 03) super 



Gemb«r-08 
(Dona 03) video 

Maggl-13 

(Mark 05) super 

Palmer-16 

(Mellnda 08) video 

Selfert-20 OT" 
(Jan 02) super 

Pavllk-17 ^(o 
(Sam 01) video 

Felkel-04 C 7 
(Dona 03) super 



HcElroy- 14 

(Carls 06) scope 0^ 

Gaughan-07 
(Alice 09) scope 

Grosf-10 

(Richard 07) scope 

Lohrouller-12 O 
(Mark 05) scope 

Conklin -03 
(Keith li) scope 

BierltE-02 qtl 
(Richard 07) scope 



Bieritr-02 07 
(Richard 07) scope 

Strouts-21 ^ 
(Jan 02) scope 



McElroy-14 
(Carls 06) scope 

Gaughan-07 ^'^ 
(Alice 09) scope 

Strouts-21 03 
(Jan 02) scope 

Lohmuller-12 
(Mark 05) scope 

Gross-10 

(Richard 07) scope 

Conklln-03 0^ 
(Keith 11) scope 



Selfert«20 

(Jan 02) tuper OZ 

Zettle«eler-22 o£" 
(Keith 11) vide^ 

Rogers- 18 
(Jim 10) super 

palioer-16 
(Melinda 08) video 

Bailey-01 OZ 
(Alice 09) 

Fe ins termsker-OS 
(JlBi 10) video 



Gould-09 02 
(Ssm 01) super 

Koday-11 

(Mexinda 08) video 



Koday-11 

(Melinda 08) video 

Zettleffleier-22 ^2 
(Keith 11) video 

GTllogly-06 
(Terry 04) super 

Ne;#house-15 0 3 
(Terry C4) video 

Bailey-01 
(Alice 09) 

Rogers -18 ^ 
(Jim 10) super 
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MEMO FOR K49b PRACTICU>1 TUTORS 

Subject: Performance Criteria and Gradin, Syste.. 

There are four criteria that determine the .rade in ^h. 

<-ne grade m the practlcum. Descrip- 
tion and weighting ;are as follows: 

tutor s n.u5t cnnHM^ ^ 20 ^u,, 

r^J^,-^,v-_tln^ CI /4 of grade). 

In order to mpet this cr^^P.-^=■ ,11 

criteria all absences must be made-up. Thia ,s 

true whether the absence is due to pupil or tutor Y 

P Pii or tutor. You are responsible for 
arranging the make-up. Ymiwiii »«j 

P. You Will need to call .nd check with Brenda on the 

time for the make-up. Make.Mn<: ck u 

ops Should try and be scheduled on Monday or Wed- 
nesday morning. Otherwise work nM^ n ^• 

out a t,me with Brenda. ConductlnH_iO^^^ 
automatically - <■ ■= •■r"7_vnii, , f an A for 1 f 

^ ^ ^^■^SlJLjoi_U±_of your grade (unless there are 

highly unusual circumstance and make-ups cannot be effected). 

There are tw. types of assignments; (D Le.son Plans .nd (2) Analysis 

-son Plans are due ^ .eek before your scheduled time of tutoring. Turn ' 

two copies of each lesson plan to Brenda 's office tor tack ^ 

oirj.ce tor tack them on the bulletin- 

board outsiJ.^ her oiflce if u is locked). 

--'^^■^^-^^^^-^^^^^^^ for tut , - 

^'^^'=^^lng tnr ^M torlnR sesainna 

°" t^^n^e (1/8 of grade). 

" V0„ ^ ^^^^ ^^^^ ^^ ^^ ^^^^^ ^^^^ ^^^^ 

grade (7/2 and //3). 
grade). 

:nc.„... ,„ .M, „ue.,„„ ,„,,„„,^„, ^^^^ ^^^^^ 

■ 155 ? 
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your actu.il lesson? 

■-'"on Pl.,„ Ev,U,,„„ ^ 

actual t.. °" ="al„,tlo„s of yo„r 

actual taach.ng subjective ,„prcsMo„s as „eU ,s 

as well as our analysis nf 

wn.Ch Will show you how tn 

'° y^""^ printouts. We „iii 

--u.e sup.t.s„t. c„„..„„. ^^^^^^^^ 

"-3->-ouca„.t.eta„.....tMssc™stat. Ct.tet.al 
through 3 permit you to «et an f„r . 

■Joins all ,ssfR„„e„ta and turning these m „„ r, 
" a-i^, s„ t.ete ,s 

.0^; —-Class can.t.et an 

"Tout est blen que finlt bien". 
("All Js veil that end3 well"). 



Note: *if Brenda's classes are cancelled 

cancelled, no mnke-up is required, 



00 
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Introduct inn 



The tutoring propram you are p-nrtlclDatlnt. <n 

V FLicipacing in this year Is designed to 

meet the following objectives; 

1. To provl.. , ^^^^^^^^ ^^^^^^^ 
selected teaching skills. 

2. To as.is^ a child who is below ^rade level in ...a. 

^ levei In reading to improve 

his/her reading skills. 

3. T„ .„ „,,„.„^ ^^^^^^^^ 
by providlne feedback on teaching perfc,r„o„ce. 

Th„, ,a., ^^^^^^^^ ^^^^ ^^^^^ ^ ^^^^^^ ^^^^ 

tlonal objectives and lesson planning Work ^h^c c 

P nning. Work this semester will concentrate 

o" "n„,„, >,o„, ^^^^^^ ^^^^^^^^^^^ ^^^^^^^^ ^^^^^^ 

those Mv. a„. t,k. tr,„,,cao„s ^^^^^^ 

"ent of specific Instructional obiectlves Ue ulll , . 

J cives. ue «111 pri„ar(iy f^^,,, student 

responses to teacher Initiated questions. 

This semester, the „aJor Instructional obJectWes In this practlc,™ are 
concerned „lth the teachln, of readln.. ospecia.l, read.n. comprehension. 
Achievement of the instructional aoal^J^^^b^^ requires first of aU 
-reful analysis of the Instructional task and then a construction of a plan 
of »ctlon for achieving the ,o,ls. A similar process takes place in determin- 
atlon and analysis of behavioral goals of tcacl.J n^ 

The focus this semester will emphasize ,oal setting for the pupil a, 
-n .s the setting of teacher behavioral goals. ,t Is certain that your ^ 

Interactions with the pupil will sfftrt ,^ . 

P Pii will affect the pupils' responses, and over time 

should affect how the pupil learns. 
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The Computer-Assisted leacher TraipiL ] Sy stcu (CAl IS) . 

The Teacher Education Laboratory in which you conduct the practicum is 
part of a unique Computer-Assisted Teacher Training System (CATTS) , designed 
for the development- and improvement of interactive teacliing skills. 

The CATTS system was developed at the Center for Innovation in Teaching 
the Handicapped (CITU) , and it is designed to provide real-time (instantaneous) 
feedback or delayed (post-teaching) feedback of information about teacher 
and pupil interactions. How feedback is used for the development of teaching 
skill will be discussed in detail in Module 3. 
Ihe Rol -" of feedback in Skill Development 

Development of teac!ang skill obviously requires the opportunity to 
practice. But as psychologists have consistently shown, practice alone is 
insufficient to assure the development of skills. For practice to be in- 
strumental in changing teaching behaviors in a desired direction, clearly 
articulated behavioral objectives for both teacher and pupil must be present. 
Another crucial variable in skill development is feedback on performance. Both 
pupils and teachers need feedback on their performance in order to modulate 
their teacliing bchavLor/leaniing responses in terns of the behavioral objec- 
tives. T\\us, the three critical factors in skill development are: (1) cleaj^ly 
defined goals or behavioral objectives, (2) opportunity to practice, (3) fcedbacl( 

The fcetlback teachers usually receive is from supervisors who often 
vary greatly in their degree of objectivity or in their preferences for 
focusing on one aspect of teaching or ajiother. The CATTS system provides 
a method of overcoming the subjectivity of supervision by providing feedback 
in the form of observation system data. The definitions of the categories 
of the observation system are public to all so that the meaning of the 
feedback is the same for both trainee and supervisor. In addition, the 

150 
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objective nature of the feedback nakes self-evaluation an alternative to 
traditional supervi5i en. 

The application of coinputei technology in teaciier educi.tion is based 
upon a teacher training irioJel also developed at CITH. Hie n^odei should 
help you visualize !^ow your teaciiing experiences will be structured in this 
practicum course. 




Behaviors Patterns Unvironinent s 



Level 5 of readier Per formance 



Figure I: CITH Teaclier Training Model 



Scimncl , M, I. AiJi^iication of Systcmntic Clnssroom Observation to the 
study of pup i 1 - teacher intcr«ictions in Special liducation, 1974. 
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- - -e-.. ..^^^ ^^^^^^ 

---—.-=H..n.u„„ suns .3 
Observation s.ste™ ..Mch focoses ..ose teac„.,„ sHHs. 

^''^"^^^^-^ -ns 

to worK. On. 



OU 

an 



3. In order to know ho.v well vn,. 

suns H , ' ^'^^^^ instructional 

^>KilIs and how to r-iOrli fx- 

-d.f> ,our perfor,n,a:.ce to bring it closer to your 

objectives, you need feedback for evnl-.u^on nf r 

evoLm^ of performance. Rather than 
having someone else evaluate your pro-^rc^s vn 

y Pro^rc... you wiU have data upon which to 

; — — » -ve .no.e. 

lessons you tcacii. 

— - —on .nfo.at.on ca. also be used for . analysis 
your pupn. perforce as well as your o.n . .d you can inco,orate 
-^3 source of i„f._.„, ^^^^^ 

^'^^ - — " - using feedback for develop.; uZ- 

active teadung skills, you c.-u. use the feedback data fo • 

^uuacK data for instructional 

decisi oii- inakiiu. - c v lpccr„ i 

J. c.,., lesson planning based upon pupil/teacher behaviors 



tion sy^siL-oSinl ^^rl^Tt^Zj;^!;^^^ ^^^^^ > --^^ Observa- 
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.ha. have actually „.er, p.a.e. Th„ inferna.ion ,„<, a.„,.„ .eco.a 
th. b.»U for hov w„, cha„„ and structure ,he Interactive 

aspects of the next lesson. 

Learning an Obser vation System 

The key to the Implementation of the training .odel (Dl scr l.ina te- 
Generate-Evaluate) and the development of interactive sHlls is knowledge 
of the categories of the observation system covering the domains of interest. 
This semester, the focus is on £u^a-^^.co,,^r^^ This is the domain 
of Interest. 

In order to interpret the feedback available through CATTS . you will need 
to become familiar with the terminology nnd definition of the Teacher Puoil 
Q uestion Response System (TPQR). You will need to be able to discriminate 
different instances of pupil responses and teacher questions that occur 
during reading, so that you can interpret feedback and modify your own teach- 
Ing behaviors. 

You will soon receive instruction on how to use the feedback available 
to you while you are teaching, and on hew to analyze the feedback data in 
planning strategies for Improvement of oral reading (Module 3). 

The next section of this manual contains the categories of TFQR 
Observation Systen. 

Read the ManunJ first. Memorise the definition of each category and 
make note of any questions you have concerning the TPQR. so that they can be 
discussed during your supervisory conferences. 
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Module 2 



Writing Lesson Plans - Required Guideline s 

The present contains descriptions of the Items to be Included m preparing 
your lesson plans. Since they are arranged In logical order for the 
development of lesson plans. It Is a gr,od idea to cher. the items and 
write your lesson plan In the order In vhich they are given. if you use 
this as a standard format In the preparation of your lesson plans. It will 
facilitate evaluation and also make the feedback more meaningful for you. 

In addition, you will find a copy of the evaluation sheet that will be 
returned to you each time you submit a lesson. The scale used on the 
evaluation sheet Is for your guidance in Interpreting the evaluation - the 
scale points are not grades and will not be used as such. 
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CliLCKLIST FOR UPITlNf, Lr.SSON PL\NS 

1. Tlin ENTRY TEST: 

The entry test shoi^hJ check the prerequisite skills the pupil 
needs in order to understand your lesson. if no rpecial prerequisite 
skill is needed, mention that in your lesson plan. If the lesson 
objective is to teach the pupil how to write his nane, you would 
expect him to know how to write the letters of tlie alphabet. Your 
entry test will check if the pupil' knows hou to write different 
letters. The entry test does no^ test the attainment of the lesson 
objectives . 

2. TASK ANALYSIS: 

llic next r<nd the most important step is a task analysis. Of 
course, your lesson plan need not contain the task analysis, but 
unless yoM do it, your subobj _ ct ives may turn out to be irrelevant 
and your lesson plan incomplete. 
2.1 Ihc Main Task is Analyzed up to Fntry Level: 

If the main task is to copy a sentence, tlie sul)tasks could be' 

1. Dcrin tlic first word with a cnpitnl letter, 

2. Lcavo small space between letters in a word, 

3. Leave Ti;ore space betwetMi words, and 

4. IMacc a period at the end of the sentence. 

We need not include the task of writing, the letters as this is a part 
of the entry behavior and checked by the entry test. 
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2-2 There is no Unnecessary' Siib tn.sk ; 

If tUc main task is for tlie pupil to write the n;itnc of his 
neighbor, do' not ask tlie pupil to draw his neiglibor's face and name 
him. Asking the pupil to draw may be a good idea to keep the child" 
busy, but it -is not a necessary .--ubtask in order to perform the main 
task. 

«» 

2-3 Tliere is no Trivial Subtask : 

If the objective includes pupils' copying a sentence, do not . 
include such subtasks as "the cliild writes from left to riplit" unless 
you liave a very strpnj; reason to suspect tliat the pupils liave to be 
tauglit this. 

2 • The Subtasks arc Arran^^ed in Suitable Sequence : 

■ In tiic cxanii)lc in item 2 tlie exact sequence of teacluni; is not 
important. But in some tasks masterinj', one subtask is necessary 
before the pupil can master another subtask. In such cases, arrange 
tlie, subtasks in tlie correct sequence. 

3. MAIN. AND SUBOlUIiCTIVES: 

The task analysis is transferred to the lesson plan in the 
form of subobjectives. Write a subobjcctive for each sul)task you 
have identified. Use the items 3.1 to 3.5 below to check your main 
objective and each of your subobjectives. 

3 . 1 The Objectives are Specified in Performance Terms : 

*'Know/' "grasp" and "understand'* are nonbehavioral terms which 
should not be used in writing these objectives. You may find the 
ALPII/XUETICAL LIST OF PHRI-ORMANCE TLRMS useful, (pg. 5) 



1G4 
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3.2 The Objectives Contain Suitable l^crformancc Raiui<^ ' 

Range indicates variations in the question asked of tlic child. 
"Discriminate between the sounds of different letters" doo^« not 
contain the range. You will liave to expand it to "Discriminate 
between tl^e sounds of p, k, n, t and d." 

3 . 3 Tl\ e Objectives Contain Performance Conditions : 

You will luive to specify what l\elp is to be given to the 

child. If Johnny may look at lus name written on tlic chalk board 
and copy it, or if you will help him wlien lie lias difficulty, specify 
this as a part of your objective. If not, say "without help." 

3 , 4 Jh/j Ob jcc L 1 vc?s Con tain Suitable Time Limit : 

This is the amount of time you giv(? Johnny to write his name 
(e.g., ^'within two minutes"). This time limit is not to be confused 
with th^ thirty minutes class time for the entire lesson. 

3 . 5 The Objectives Contain Suitable Performance Standards : 

If you want the pupil to perform witliout any error, write 
"witliout any mistake," or "witli loo's accuracy." If you do not 
expect such perfection write "9 out of 10 items" or some other 
suitable standaril. Anotlier type of standard is to specify what 
tl\e response should be. You want Jolmny to use capital J, and you 
will not accept ,nny siiclli'ig mistake,; but you uo not mind if 
Jolinny's writinr. i? not perfect, as long as it is legible. 

4. CRITURIOM TFISTS FOR MAIN AND SUBOM.II-CTIVT.S: 

No doubt your criterion test. is built into your classroom activity. 
But the activities arc planned on your criterion test and not the other 

er|c = iCj 
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act iv? ' i^^s . 

"•' ^!3iaJ:£lUj_JLjL!ll l.'l Measure of tl,. O hi^;^. 

If J0i,„„, is to write his friend's n'^T^cl, M„ to dra„ lUs 
fricnd.s picture „„d „„„o it. if ,ou want to. „„I^ „,t .uil. a 
criterion test around drawing „ictures. r„c criterion test measures 
tlie objective, notluns more and notlun,. less. 
5. It.'.aillK; STI!ATCKtl;S: 

The fol,o,<i„„ itc»s are often, a »,atter of individual iudgement 
and intuition. Similar.,, evaluat^ns may be subjective. Keep this 
tn mind when react infi to the evaluations. 

^^^aiil^Sl^IiUaterial^^^^^^ 



^iHilSlii-lictivitie^areW.^^ 



Cri tcri OIK " 

Over all Layout is Done wiM. rJ r^ 



n 
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ALPllARETICAL LIST OF mRFORMANCP. Tr.PxMS 



build 

classify 

color 

combine 

compare 

complete 

count 



road • 
recal 1 
recopni ze 
restate 

say 

select 
spcl 1 
state 



discriminate 

distinguisli 

drtx'w 

explain 

fill in 
finish 



toll 
test 

underl ine 
use 

write 



j^, ive 

idcnt i fy 
imitate 

keep 

label 

list 

locate 

nake 
matcli 

name 



organize 
plan 

quest ion 
quote 
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^495 Spring, 1976 
NAME 

, ■ ■" ^ DATE 

- ~— • Lesson No. 

CHECKLIST FOR LESSON PLA^N- EVALUATION 



1. Entry Test 

y iovel of the target student. 
lMec""L:"' HclHSos t„e lesson 
2. Task Analvmjc 

2.2 There are no unnecessary subtasks. 
Tl,ere are no trivial subtasks. 

H';:„t"'= "'^^"^ " -"able 
^« Objectives 

3.1 J^e^objeetives are specified in performance 

Per^^i^L^^r^Lt!?"'" = 

3.3 The objectives contain perforraice 
condrtxons. Ce,uipn,ents! aS eJc.) 

3-^ Tl.e Objectives contain suitable ti„,e limits. 
I?:nd°ajd":"" performance 



NO 

1 



1_ 
1 



1 

1_ 
1 



_2_ 
2 



(OVER) 
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Criterion test for main and subobjc ctives 

4.1 The test is a valid measure of the 
objective. 

Teaching Strategics 

5.1 The instructionril materials used arc 
appropriate to the objective. 

5.2 The steps in teaching are relevant to 
the criterion. 

5.3 The overall layout is done with care. 

5.4 Lessons arc well planned for the period 
of activity. 



IG3 



,,;7 ^495 Spring, 1976 

M. C. Sltko 



TPQR 0BSEI5VATI0N SYSTEM 
Introduction 



You will be using an observation system to study both teacher and student 
behavior Interacting In a teaching/tutoring situation. An observation system 
is a tool used to describe behavior as objectively as possible as It occurs 
tn the classroom. This observation system focuses student responses lo 
teacher initiated questions. There are different types of teacher questions 
flnd student responses. This system Is designed to observe categories of 
higher and lower level re'sponses and questions. "Higher" and "lower" are 
defined in terms of the cognitive processes the student must perform in order 
to respond appropriately. The specific content of the lesson will help you 
decide which cognitive process the student is using when responding to a 
specific teacher's question. 

The system hns six response question categories. It han three additional 
categories dealing with other behaviors. It is your job as a teacher to 
memorize the categories, their definitions and their numbers. 



1 70 
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Stage 1 



Ex planation 



Teacher asks 
Student responds 
Student asks 
Teacher responds 




2 . Discrimination 

3. Recall 

4 . Sequencing/Paraphrasing 

5. Hierarchically Relating 

6. Inference 

7. Problem Solving 



Teaclier 
Student 



8. Talk on lesson subject 



fsTl ''No," can't," no response, 
^--^ "I don't know" 



6.1 Not codable 
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In the actual tr.lnln, and codlnR situation you will be uslno a button 
box, which will look like this: 



Send 



0 



CD 



Clerr 



You will be coding the question and response behaviors via a number of 
coding 3ysto„.s. through the use of the button box which Is linked to a com- 
puter. The way in which you tell the computer what you have observed entail, 
a two stage procef;s: 

stage I: For categories 2 through 7 you must designate the Initiator 
and the responder of the Interaction. You must push one 
button only. 

stage 2: You then need to tell the computer In which category the 

question or the response belongs. For this you will use the 
number codes for the categories as will be explained In this 
manual. 

After coding each question or each response you need to push the 'Send' 
button In order to send the information Into the computer. 

Note: 



I. A question is a question if and only if. when written out- one would put 
a question mark behind the expression. For examplo: 



i 7" ' 
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Qucn t iona 

a) Can you put these pictures In 
order? 

b) What does this word on the card 
say? . ^ (the student does so) 

. . . and this one? (questioning 
Intonation) . . ^ (child does 
so) . . . ancJ this one? 



1 



Grammatically, these expressions re- 
quire a question mark, either by the 
sentence structure or by the qucs- 
tlonlne Intonation. So, they are 



Not questions 

a) Put these pictures In order. 

b) Tell me what this word Is 
(the student does so) 

and this one (commandi np, InN 
tonatlon) , , . . and thlJ one. 



1 



Grammatically, these expressions 
r'o not require a question mark. 
So, they are not 

• • • 
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CatCRorv 2 - niscrlmtnnt i 



on 



Definition 



F.c» hive .0 be completely or p,„lelly perceived by .he .e„,ee. 
Extension nf Hpf<^iK^^n 

The co„«„t Of .he .pproprl.te response „ dlrecUy perceived by che 
»^n,e,. including heerlng (sounding on.. .pelli„„ f,,„„^. 
■ s.uden. 1, .0 indlce which .h,„«s are .U.e or dlfferenc or Co choos 
or confirm a correct answer fro. s se. of eKpUcU ,Uer„,c,ve 
Examples 

St: (Sorts cat cards into one pile and .at cards Into another ptle.) 
St: "Are your shirt and shoes fhe same color?" 
T: "Yes." 

T- "UMII you fine' nnother one that looks Just the san.e?" 
Si:: (Points to -a letter.) 

St: "Can you tell me what le in the picture?" 
T: (Does so.) 

2ir.,ri::j:;[sv'^ ^^^^ -^^^^ °^ ^^'^^ ^--^ -u 

St: (Feels the shape of th^ letter.) "A • b ' . I th ink . " 

T: "Cjn you point to the letter 'A'?" 

St: (Points to the letter 'A'.) 

St: '^Which sides of the rectangle are longer?" 

T: "The left snd right sides." 

1': "Can yox: show me the word 'clown' 

St: (Shows the word.) 
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T: "How do you speU the word 'cnt'?" 
St: "C--hm--A and T," 

St: "What doeT-thls letter sound like?" 
T: "[Pa]." 

T: "Can you 5ay this word?" 
St: "Pan." 

T: "And can yon read* this word?" 
St: "PUlcw." 
*For the purpose of this mnnunl. 'readlnp' ^^ Hof* n- 

words or more: I po- D.id wenh ThI u ^' ^^flnco as a discourse of two 
words «re coded as^iscnX^t [o^ ' ''''' Tl>erefore. single 

2.5 Exercises 

Examples and non-example, of Discrimination are given. 
2.5.1 code I 2 after each Teacher Discrimination question. 

Code 3 2 after each Student Dlscr Inlna t Ion question. 

Code 2 2 after each Student Discrimination re ponse. 

code £ 2 after each T.acher Discrimination response. 

Do not code the non-exampj es . 

happened Lu Jlmny on the way to school ? 

St: "Jimmy found a one-dollar bill." 

b) T: "Are these two words alike?" (Holding up 
flashcards.) ^ ^ 

St: "Yes."' 

O St: "13 thl. the letter 57" (Points to the letter S) 
T; "Yes, tl-t Is an S." 



17 
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T: -If I p„t a Rlaas upside down over a candle 
what: happens?" ' 

St: ^^i know. The light goes out." 

e) ' St: "Teacher, what Is this word?" 

T: "That reads 'bear ' ?" 

f) T: "Car you read this word?" 
St: "Yea, that IS 'graus'." 

g) St: "How does this letter sound?" 
T: "Sssa.." 

h) St: "What would you do. If your house got on fire?" 

T: "Run out ns quick as possible and call the 
f Irepersons ." 



-J'Japnas pq^ Xq paAjDOJad 

-^noa:.fP aq .ouuen pa.jnba. uone.aojuT aux (qpue ,p '(a ; sbidu^.x^-uoN 

^ , , , '^uopaqs Dili 

^ .r3A,3DJ3d AnD3J,p gq UVD pojtnbbj uonBi.uoju7 aqq 

• pazjuSoDaa gq seq quauio^sqe e jo ssouqooaaoD aqq ^3 ./^ , 

pa^BDipu, aq oq soq gpaua^jiTB up (q tsai^EXs 



2.5.2 



examples : 



In the blank spaces give %xamp,Ua and non-ex^n.ples of 
Discrimination questions and responses. 



> . II 
T: 

T: " 

St: " 

Y: " 

St: " 



ire 



3 2 
^ 2 
i i 

i i 

1 1 

2 2 
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St: '* 
T: 

non-examples: T: h 

. 'J St: 
T: 

St: " 
St: 

T: •» 

St: 

T: " 



Create the exan,ples yourselfl Do not cheati 



o I;? 

ERIC 
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CateRory 3 - Recall 

3.1 Definition 

Facts have to be recalled from memory. 

3.2 Extension of definition 

The content of the appropriate response cannot be directly perceived 
by the student but must be recalled from memory. However, the student 
is not required to further act upon the recalled informstiun . 

The requested information may be single or multiple pieces of 
information, which are not related in a hierarchical fashion. Facts 
are merely listed. The requeseed information may be objective or 
personal and may have been learned at any time in the student's life 
prior to asking the question. 

a- 

3 . 3 Examples 

St: 'Vhat what was the girl's name?" 
T: "Dina." 

T: 'Vhat did you see at the zoo?" 

St: : "^tonkeys, elephants, a great big bear and lions and tigers." 
St: "What kinds of ingredients do you need tr> bake a cake?" 
T: "Butter, eggs, sugar, flour, and you can put raisins in/' 

3. A Notes 

3.4.1 Do not confuse Recall with Discrimination. 

St: "Did Johnny's mother take St: "Look at the picture in 

him to the store or to the your book. Did Johnny* a 

park?" mother take him to the 

store or to the park? 

- T: "I think to the store." T: "To the store." 
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T: 



"Can yoii describe 3 
cas tie CO us ? 



St: "/Ccastie has usually many 
to^'crs, . lot of big rooms, 
and . . , '• 

T: "Can you describe to the 
class what a turtle looks 
like?" 



St: 



"Let's see. A turtle is 
small, has a little roi^nd 
head, a shell for Ms back 
to protect his body, four 
lets, and a little tali." 



i 



The response cannot be directlv 
perceived by the student, but 
has to be pulled from memory. 
So this Is . 



St; 



"Can you describe this 
castle you see here (on 
a slide) to us 7" 

"It has 6 towers, a kind 
of canal around It. and 



T: "What do you see, looking 
at this turtle?" 



St: 



Four small legs, a hard 
shell as his back, and a 
funny little head." 



Tne response Is fn front of the 
student A perceptual discrimi- 
nation has to be made. So. thia 

1- " ■ 



Exercises 

E«a«ples and „o„-e,:a»pI„ „t Recall are given. 

Ltli- ,-„:J:L:-^ "".e. .can ,„a3Uon;3 3 a... a ,.„aa„. 



Do not code the non-examples 



a) T' 



St: 



b) T.- 
St: 

c) St: 



T: 



"Which cuior is red?" 
"This ball is red." 

"^/hat did you watch on TV yesterday?" 
"Sesame Street." 

"Wh..t would you do if you found an injured 
cat on the road?" ■ = mjurea 

I^^Call the veterinarian right away, and take 
care no one moved the cat.'^ 
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T: •VUst did the gi^l m the story do that got 
ner into trouble?" ^ 

St:_"she kept pulling the cat's tail." 



paA,„j,d ,„'^''°°"° P'"""" '1 »5 "<i 3"q 

,q ,0„„„ p,,„„,„ „„„.„„^„, ^^^^ ^^^^^^^^^ 

3.5.2 I„ ,He Ma„. .p,„.. „„„.„,„pl„ 

Recall questions and responses, 
examples: T: 



St: 
St: 
T: 

non- 
examples: T: 

St: 

St: 

T: 



ERIC 



1 1 

2 3 

3 3 
A 3 

1 _ 

2 _ 

3 _ 
4 
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Facts have to be perceived or reca".. . ^ 

reca...d and sequenced In time. 

2 Ex^enVon_o^_Defi^^ 

perceived by the student. The re,n 

called - d . "'"'"^ '^^^^ - 

called £nd ordered In time, or (2) to hP 

Seoe . ^'^'°''P^"^^-^iili-cleredlntl.e. 
Sequencing explicitly demands a description o 

"^P"^^"" or creation of a " 

"""" °' " v..„,u, ^„^^^, _ 

. - , vents. Pcraphraslne 

„ J . 1 ui. Visually and temporally 

ordered events Po-, u ^ 
P3r,p.„.,„, _ ^^^^^ ^ 

create a story. 

^ , ^^^^ ^^^^ ^^^^^^^ 

"Iddlc, next, la.t, before, aft„ ,,,,,, , 

, , • fl-lly) re,„ue a 

tl™e.„rderi„„ ele„e„t l„ (He co„.tr„cM.„ „f the 

re.po„.e „„, .He H ' 

^^^^^^^^^ ^ 

no. co„,»„.„„„ „,„ ^ 

and could consist of 

only one word. (See last example under 4.3.2.) 

j|xa mj> 1 e 9 

^.3.1 Soquencinp. 

St: (Doea so.) 
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T: "Can you put these pictures In order so they tell a story?" 

St: (Does so.) 
4.3.2 Paraphrasing 

T: "What vas this story about?'' 

St: (Retells the story.) 

T: -Can you tell me everything that happened In this story?- 

St: (Does so.) 

St: "Who entered the svlnunlng pool first?- 

T: "I believe It was John." 

T: "Would you summarize this page "or me?»' 

St: (Does so.) 

T: "Did John hit Sue before or after the pencil was missing?" 

St: "Before." 



^.4 Notes 



4.4.1 Do not confuse Sequencing/Paraphrasing with Recall. 

T: -Whnt was this story about?" St: "What happened to JlmmyU 

bat In thli story?" 



St: (Tells story.) 

T: "Who first noticed that t 



-The hat got lost.- 



,r K " '"^ ^= "^^^"^ that Jlmmy«. 

Jimmy's hat was missing?" ha^ was missing?- 



"Henedld.- st: -Rene did.- 



time. So. this is . . . student does not hav- to do any 

thing with the facts. So, this 
Is . . . 

4.4.2 Do not confuse Sequencing/Paraphrasing with Discrimination. 

'''' bo^f.L' J?'" ^'T'!' ^"^^ ='Wni you tell me the story 

both the Hons and tigers tbout the Hon and the tiger 

eating the meat?" who became fvJends?" 



ERIC 
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St: "Yes, they are. 

T: (Pointing at a series cf 
— pi-cturcs out of order) 
"Can you tell me what you 
see in these pictures?" 

St: (Describes the pictures.) 

1 

The stimuli are in front of the 
student to be perceived. The 
student does not have to act 
upon the informat ion . So , this 
Is . . . 



4,5. Exerc Ises 

Fill in the correct cedes. 

4.5.1 a) T: %M11 you surr-marlze the st^ry you have just read?" 

•Johnny lost his hat/' 



T: (Does so.) 

T: (Pointing at a series of 
pictures out of order) 
"Can you put these pictures 
In order? 

St: (Does so.) 

Events have to be ordered in 
time- So, this is • • 



b) St.: 

c) St; 



d) 
e) 



T: 
T: 



f) St: 

?.) T: 

h) St. 



"Can you sort the cards with the word cat on 
them into one pile and the cards with the word 
mat into another pile?'* 

(Does JO.) 

"Will you tell me all the things that happened 
to Little Bear on his way to visit his Grand-, 
mother?" 

(Does so.) 

"Cm you put these pictures so that they tell 
a etory?'* 

"That's an elepliant." 



•s3uoiDq M U^Pl^ /!io3aqED u\ popoo s| asuodsoJ aaq/BiJi 'aouods 
-oa atjpjadoaddpu] uf? p|»cuj iuopn:js aqj 'aouptjsui s^iiq "I •uo^qsanb aaqoca:} aq^ 



n Z 
Z V 



(M 
(P 



T (3 



1 1 

^£ Z 



<q 



V \ 

V T 



(3 
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Give your cvn exanplea. Uote ^hat .h. 

q-stlons and responses 

are predetemined by the c^des fn 

^, ^" "^^^ rfght-hand cola.n. 

St: " " 12 

watch outi 

St: " " 1 ^ 

T: "22 

T: " il 

St: " " i- £. 

St: " "21 



T: 



2 2 
4 4 
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Category 5 - Hier.irchlcal Relpriro 



Definition 



Known facts have to be perceived a.d then related, to one another, In 
a hierarchical fashion. 

Extensi on of defin<M-nr, 

Facts have to be perceived or recalled and acted upon. 

The content of the appropriate response requires the student to 
compare or contrast .noun facts; to categorize non-identical observation, 
by their cor„.on denominator; to explain events or concepts; to give 
examples of concepts; to define events or concepts; or to find synony.s 
or oppositcs. 

„„t t„ ,p«.fU, .„...J.„., ev=„,3. There „o ,„e„,„, 

Examples 
5.3.1 Compare 

"How are these two letters alike (b-d)?" 

•'Well they both hnve a circle and a stick - but the cirOe 
le on different sides of th. stick, —and you almost »av 

^l«ct^:r^ ^^^^ ^^p^ 

St: "What is the opposite of high?" 
T: "Jow." 



T: 

St; 



St 



Hons."' '''' ''''' '"^^^ diffe..nt fro.. 



ilgera have stripes and Hons can climb trees. (In this 
case the te.cher ,nve an incorrect but atlll hlerarchlca ly 
re ated answer. The teacher did mnke . comparison. See 
page 35 for further expinnatlons . ) 
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T: "Vhy are castles an:? teepees alike?' 

St: ^'Because they both serve as a shelter place, as a house, a 



5.3.2 Categorize 



St: "Can you think of one word to describe all of the following: 
nllk, cheese, yogurt anc butter?" 

T: "Dairy products." 

T: "Can you put all pictures which have flowers In one pile 
and all the pictures which have animals In another?" 

St: (Does so.) 



5.3.3 Explain 

S^: "Why does It get dark sometimes during the day?" 
T: "Because the clcuds block the sun." 

St: "Wlien I let go of this book It falls down. How come?" 
T: "Eecause a little man pulls It down."* 
T: "What does friendship mean?" 

St: "Friendship Is when you can think and feel aloud when you 
are with someone," 

T: "Wliat Is multiplication?" 

St: "Wlicn I take a number so many times, for Instance, when I 
take '4' three times." 

'^Here too, the tinswor Is incorrect but It is nn attempt to explain, there- 
fore code It as an Hierarchical Relating response. 

N ote? 

5.^.1 Do not confuse Hierarchical Relating with Recall. 

St: "Would you explain to me St: "Can you explain what the 

what the lion did to the vord •ainblguous* means?** 

little recuse in the stcry?" 

T: "Well, the tiger got caughf, T: "That you hvr ^'^.t sure 

caught in a trap, end . . . whether it la one way or 



etc. 



" anothar 



^ ^ u 
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S t : 



'*M^ry, hcv vas the castle 
described in the st:cr%'?'^ 



Ic --.MS big and ha^i a lot 
of Covers. it ^Iso had 
wide vooJen stairs fnsldc 
and rrany rccms and it h;5d 
a drawbridge/' 



T. -"^^ry, can ycu find cne 
^•ord to d-^^scribe the 
concepts: cottage, 
castle, house?'^ 

St: ''Hcnes, or dwelling 
places , 



i 



Fncts hv/e to be s imply 
recalled. So, it is . , 



Facts have to perceived or 
recalled and then related to 
one another. So, it 



5.A.2 DO not confuse Hierarchical Relating with Discrimination. 



T: 



St 



"Cm you describe the ti^er 
you see In the picture?*' 

"ItVs like n blR C3t'- 
yellrvish and it has 
s tr ipes 

"Cm you sort out the pic- 
tures vlth the do^ fron the 
pictures vlth the rose?'' 



St: (Does so.) 



T: 



St; 



'*Vhnt Is it that tigers 
have that makes th^m 
different from Hons?'- 

"Tiy^ers have stripes 
and lions don't." 



"Can you put all pictures 
which have animals In one 
pi le and all pictures 
which have flowers in 
another?*' 



1 



St: (Does so.) 



The fncts arc in front of the 
sJ^udent to he perceived. (Mly 
^ nlrplo response is required. 
S", it is . . . 



F.Tcts cannot only be perceived 
or recalled: they have to be 
related to one another In some 
vay. So, It Is . . . 



5.A.3 Don't j^u..p to cone I'us ions when you see words such .s describe a.d 
explain. These words often introduce a Hierarchical Relating 
question, hut not necessarily so. You need to p.y attention to 
what cognitive function che question demands, for example: 

"Hcv would V'UJ Hp« ''r*^ I 

scribe .har'you see ^ buildr f ""ow would you de- 

in this plcturp?" ^ i ""'"^ 'grief 

pictures (no picture is avail- means?" 

able) ^ 

.'lb? 
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Icoks like in the 



pictur^" 



1. 



All that is required 
is to desci Ibo what 
Is seen. The facts 
are in front of the 
person to be per- 
ceived. So, It Is 



'"«*::'jH ycu e.rplr? in 
*-* hi r t he h idling 
ve ycstcrcav 
looked 1 f kr ?*' 
I 

\ 

The fact5^ cnnr.ct be 
perceived buc have 
tc be recalled frorri 
neTcry. What Is re- 
quired is to list 
facts . The res ponder 
is net aalfCd to act 
upci t.:e recalled in- 
for-uUion. So, it is 



**Hc^v vculd ycu ex- 
plain tlie word 
'verdict'?*' 



Recall is involved 
but the responder 
has to act upon the 
recalled inforraaiiion 
by relating the facts 
to each other. So, 
it is . . . 



5.5 Exrrc iscs 

5.5.1 Consider each question-response event and fill in: 

Examples of 
category 5. 



ves 



no a) St; 



yes no_ 

yes no_ 

yes no^ 



yes_ 



no 



yes no^ 

yes no 



yes no 

yes no 



b) T: 

c) T: 

d) St: 

e) T: 

f) St: 

g) T: 



yes no h) St 



J) 



1) St: 
T: 



'^'hnt's that in the boy's hand?" pointing 
to a picture.) 

"A haTjner.*' 

•'Wliat is fruit?" 

''Fruit are things ycu cap eat which are not 
^Jniry products, meats, ver,etah:es or grains; 
things like apples, oranges, pli:ms . pe'aches!" 

'•Can you put all the cards with the word 
Vilk' in them here, and tiie cards with 
'cheese' on them over there?" 

(Docs so.) 

"Ann, tell me about your plane ride, what 
all did you see?** 

"0!\ I saw the h-usc*; and roads becoming 
real tiny and then they disappeared; and we 
saw* clouds close by.*' 

"How are these letters different?" 
'*They are not the sam.e."* 



The correct 
code is: 



EKLC 



so 



176 



Z 2 --'^ (f 
2 I *ou (a 



? I t sa>; (p 



^ Z 



2 j_ -c'j ('3^ 
c 7 'ou (q 



6 e -cu (e 



5.5.2 M^Ke .p 4 examples of category 5. (The student -:,oes not 
necessnrlly have tc give a category 5 answer.) 
Compare: f. »» 

If 

St: " 

f I 

Catep,orize: T: "" 

ft 

St: " 

ti 

Explain: St: 

It 

T: 



Define: 



T: 
St: 




i SO 
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Category 6 - Tr^ay-s^p 



ence 



^■ijslon of definition 

c<,„.,„. ^^^^ ^^^^^^^ ^^^^^^^ 

question. TSie response to ;in * #: 

' an inference <,„e,Uo„ Is not ,,„ca, given 

in the lesson, thereforo ^^o 

herefor_. the response cannot be si.piy perceived. 

recalled, or found through ,relati ng facts. 

--er. the student has. .a.e a logical step .th,n the H.lt. of 

B.ess,-ng.. is ln.ol.ed. .he studen. doe. 
have to constr.ct ne. .^ledge hut r3th<. select fro. loglc.I 

possibilities m reaching a conclusion. Often but not , 

witen, but not always. Inference 

questions ^efer to a specific situation. Tvplcallv i f 

n. ivplcally, Inference questions 

ask for: 

(1) What n,lRht happen (after an event) 

(2) What night have happened (before an event) 

'3) Ocher person(fl) motivations for a o-,^,'. . 

tor a particular act (why would 

s/hc do that, or have done that) 
(^) The consequences of hypothetical situations (what would 
h'Tppen, or have happened, If ... ) 

6 . 3 Exani pj_e3 

T: "What do you think hapr ns on the next page? 

St; "I think, the bear might attarV m« i, 

bear might run away." ^ Perhaps. the 

er|c . Inn 
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St: *Vnat cculd Jonathan's tacher have said that ^zde '^n;=^tha- 
sad V 



T: 
T: 
St 



•perhaps he said thar he clc- r.oz Icve Jonathan ar.vn-ore.' 

'Why do ycj tr n your r.cther read che newspaper last night?'* 

'Eecaiise she wantt-d to find about that hijacked plane."' 



T: "Vh.it vo-ald happen If all of sudden all people decided not to 
work an^vT^ore 7" 

St: 'Ve'd all die after a vh'lpl" 



6.4 



l.'o tcs 



6.4.1 Do not confuse inference with Explanation. 



W h V d c cars break down?'* 



5 c : ''T:)f*v £3 0 l^iC too o 1 (5 , or 
t^'f cvner did net take 
care of it, or It is ji'St 
a bad car." 

T: "Wliat nakes it rain?" 



St: " A np o 1 g are t h r ow i n^, 

hudtcts of water on the 
earth/' (Incorrect, but 
It is an explanation.) 



The r. t\i']t*nt hnc to verba li7-e 
wha t r. /he a I roa<i y kncws and 
explain a penrra\ stat*'« of 
affairs hy relating facts. 
So, it is, . . 



T: "Vl;y dc you think John's 
car Ijroke down?"" 

St: "Jchn had been drivinp, 
his car foY more than a 
year without taking care 
of : 

T: '^What v^ould .ppen if it' 
rains for two weeks? 

St:, "All my shoes would be 

scjking wet, because they 
did not have a chance to 
dry--and the rivers mighc 
overflow. 



The student has to infer what ' 
mir.ht have liappencd or ha^ to 
look forward into the--hvpo 
thet3cal--futurc and preolct 
vhat ni?>ht happcu in a specific 
contex;. So, it is . . . 



6.4.2 Do not cofifuse Inference with Discrimination or with Sequ^ncin^/ 
jiirasinp,. 



,T: "In this picture T: "Why do you 

did Sue hit John?" think Sue might 

have hit John?'' 



"Wliat happened 
before Sue hit 
John?'' 



10. 
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St: ''Yes. 



St: 



The stimuli are in 
front of the student 
to be perceived. The 
student does not have 
to act upon the infor- 
mat Ion. 



''Perhaps, John 
had taken her 
pencil away or 
scmGthing.*' 



Another person's mo- 
tivation hss to be 
Inferred. So, it 
Is . . . 



St: •'Well, first 
Sue started 
whispering to 
Paul, then she 
. . . etc." 

Events h^ve to be 
ordered in time. 
So, It is . 



6. A. 3 Do not confuse Inference with Recall. 

T: 



T: "What happened to make 
Donna leave home?" 



"What might Donna's mother 
have said to make her 
leave home?" 



St: "Her mother was mad." 



St 



Information required has to be 
pulled from memory. So, it is 



"Perhaps she said, 'I hate 
you. I don't want you 
here anymore . • " 

i 

Information required is not 
in memory and has to be 
logically deduced. So, it 
is . , . 



6.5 Exercises 

6.5.i Make up one T question and St response belonging In the Inference 

c a L e ^ 

category. Then transform the Inference question-response event 
into a Discrimination. Recall. Sequence/Paraphrase, and a Compare/ 
Categorlze/Explaln/Deflne question-response, 
T: " 



Inference ; 



St: 



Discrimination: T: " 
St: " 
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Recall: T: " " 

Sequence/ 

Paraphrase: T: •* 

St: 

Hierarchical 

Relating: T: " •« 

St: " ^ " 

6.5.2 Do the same for a St question and a T response. 
Inference: St: " " 

T: " 

Discrimination: St: " 

T: " " 

Recall: St: " 

T: 

Sequence/ 

Paraphrase: St: " 

T: " " 

r 

Hierarchical 

Relating: St: " «« 

J. II • II 



1.93 
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Category 7 - Problem Solving 

?.l Definition 

Knovn facts are used in new cc.binations . or new knowledge is constructed 
to solve a puzzling situation. 

7.2 Extension of Definlt<nn 

The concent of the appropriate response must be a possible solution to 
the problem or puzzle. The student has to understand and analyze the 
information stated in the problen. However, no direct cues are pro- 
vided to guide the formation of the response: the student has to con- 
struct new knowledge in doing so. The student has to decide on his/her 
own. how to proceed in solving the problem. A problem solving question 
is often posed directly at the person who Is to respond: "What would 
lou do . . .?,'• .Tnd puts the responder in an active position. The 
responder is asked to imagine playing an active part In finding a 
solution to the stated problem. 

7.3 Examples 

T: "Can you think of new ways to earn money?" 

St: -'You could start doing grocery shopping for, people and go to the 

:rs"v:rthattr" "'^^ '-'^ 

St: "We have to stop this cat from jumping on the table while we are 

eating. I don t want to spank her. What else do you think we \can 

hpr' P^'^'P" P""^ °" the floor for 

her while we eat, or put her outside every tir.e she Jumps on the 
table, or tie her to a chair." 
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7.4 Notes 



7.4.1 Do not confuse Problem Solving with 

T: "Vhat would vou do In 
such a situation?" 

St: ■'! probably would cryl " 



Inference . 

T: "Why do you think John 
started crying?" 



St: "How would you fix the TV?" 
T: "Put a new larp In." 

T: "Hov would you. fix that 
broken bike?" 

St: "I don't know— perhaps 
It can't be fixed any- 
more . " 



St; 

Sc: 
T: 



St: 



"Perhaps he thought that 
his father would give in." 

"Why doesn't the TV work?" 

"I think the lamp is 
broken." 

"Why do you think Sue 
would have wanted to fix 
the broken bike?" 

"Probably, because she 
knows that without a bike 
she would have to walk to 
school, and that would be 
a long walk." 



A puzzHnp situation Is pre- 
sented nnd the responder has 
to inapine himself or herself 
how s/he would go about 
finding a solution. The re- 
sponder is asked to play an 
Inaginary active part So 
it is . . . 



i 



7.5 



T!ie response requires th'' re- 
sponder to infer what another 
person's reason for a partic- 
ular act could be, or could 
have been. Or, the student 
has to infer what might have 
happene.d. The responder ia 
not asked to play an active 
part, but merely to be a 
spectator making an inference. 
So, it is . . . 

Exerc Is eg 

'.5.1 PiU .„ ^^^^^^^^ 

"latching the codes provided. 

^) T: "If you want to go to the ci^r,,^ u 



St 



2 7 



id:] 
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b) St: "Hcvvcld you define the vord 'happy, 
T: 



St: "Kcv could vpu j 

>cu train a dog to dc cricks?" 

T: 



T: 



St: 



T: 



" 4 5 



4» 3 



4 7 



2 3 



4 6 



5 E (q 7 T (a 



i 9'' 
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7.5.2 Create a script of St or T qr^estlons and T or St responses, 

• containing at least 3 Problen Solving questions ,=.nd 3 Problem 
Solving responses . 



T: 

St: 

etc. 




IV? 



u A 

R T- 
I ; 

I I 

C 3 

A C 

L I 
E 

S 



CATEGCRIES 



Dtscrbination 



Facts have to be 
perceived by the 
senses. 



Pacta have to be perceived by 
the 8cn.^es. 

Facts have to be recalled fror 
Jicmory. 



Facts have to be perceived or 
ifcaHed and ordered in ciriie, 



known facts have to be per- 
ceived or recalled and re- 
iited to one another in a 
hierarchical fashion* 



Antecedent: facts are used to 
predict a logical ^contlnua- 
tlon cjf trenc:: :r cr^-nsequences 
by choosing ajsraif =2 nuaber of 
lojicil altsrnsccv^RS, 



hm 'facts ar^ ^m'^^i in new 
COlitoclcw, :r ir^f kncwl- 
edgp l^ comatrxTf^ :o solve 





Secjuencing/ 


Hierarchical 


■1 


Prablea 


recall ' 


Paraphras ing 


Relating 


Inference 


Solving 


facts nave 


tacts nave to 


Knovn facts 


Antecedent 


Known faces are 


to be re- 


be perceived 


have to be 


facts are 


used in new com- 


caiieQ ircri 


or recaiiecj 


perceived or 


used to pre- 


fainacioas, or 


ner»ory. 


and ordered 


recalled and 


dict a log- 


new knowledge is 




in nine. 


reiateo to 


ical contin- 


constructed to 






one another 


uation of 


solve a puzzllnj; 






in a hier- 


trends or 


situation. 






archical 


consequen- 








fashion. 


ces by 
choosing 
among a 
nu:nber of 
logical al- 
ternatives. 





' critical attrlbi:i::i; ! Clhanifriarlstic 
shared by all qi2*an:ions i^. -respmnses 
coded In that ci^tef^jory. 1 rss^m^nti' 
th.^ essential c ^i^rrla fci: wbmhlf 
in that categcrv 

irrelevant attrife !:e: tea^tirirtlc: 
which are sharec "jy soae m ill 
questions and responses im that cacst^ry. 
The category may or oiy not have cb»r- 
arrer<«ftc 0. ' 



M 

00 
01 
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The preceding chart Indicates that (1) categories .ay or ..y net include char- 
ac.rtstics of catep^ries vith Icr.er nunbers. and (2) you should not Ju.p to 
conclusions if you recognize a characteristic of a category. For instance, higher 
nu..ber categories often do include recall, but they de.and . cognitive function- 
ing over and beyond rec. ' 1 . Likewise, don't ..^p ,o conclusion, one of the 
tirr.e ordering words ^.,3t ., ne.. , before, etc. ) t. part of the q.o.rtion: it 
is not autonatically a 5. .uct^. a,/Paraphrasi.,; v.estion. for exan:,ple : 

T: 



T: "VThich lights vent 
first?" 



T. "Did the lip'-c- 
out?*' 



St: "The lights in th^ 
bedroom/* 



What Is required is 
order events in tirre. 
So, it is . . . 



St: '•Yes/' 



All that is neces3:ar^ 
is to recall a slmpl. 
frzct. No further 
act icn is requirec; . 
So. it is . . . 



St; 



"Vhcit would you do 
If tH)e lights went 
c\:: first?" 

" a flashlight 
£rn.:l Jook for candles 
and ^Ttnatches /' 



i 



A tf ne-ordiering word is 
included, however, the 
cogr.it Ive demand goes 
over nnd ^rcyond se- 
quencing, the responder 
is nsked to imagine 
playing an active part 
in solving the problem. 
So, it is . . . 



2U'J 
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Category 8 - Talk 

8.1 Deff-nltton 

Talk Is defined as teacher or student cognitive demands or other verbal 
Interactions which cannot be categorized in any of the other categories. 

8.2 Extension of Definition 

Talk includes: value judgements (opinions), rhetorical questions, 
procedural information questions, habitual responding, and any type 
of talk which does not require an overt response. 

8.3 Examples 

8.3.1 Value judgements - opinions 

T: "Did you like this story?" 
St: "Not really." 

8.3.2 Rhetorical questions - these questions do not require a cognitive 
demand. The answer is given in the question. 

T: "Choice A is the right answer, isn't it?" 

8.3.3 Procedural information questions 

T: "Do you want to color with a blue or a r2d pencil?" 

St: "A red one." 

T: "Did you bring your library money, John?" 

St: "Yes, here it is." 

St: "Are you sure?" 

T: "Sure." 

T: "Do you think so?" 

St: "Yes." 

2o: • 
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8.3.4 Habitual responding 
rj- "Repeat, af cer me." 

8.3.5 Any type of talk which does net require an overt response such 
as lecturing, feedback, procedural, ccn^^anding or expanding on a 
response, and requests to read: 

T or St: "Let's go on , . 

"Tell me what this word is,"* 

• . and this one , , 

. . and this one , . 
It regularly happens that a teacher (or a student) first gives 
information before asking a question. For example: 

T: "John let's look at thJs ncv. this picture in this book, 
right here. Can you tell what this figure is?" 

The first sentence is quite substantial and provides enough time 
to code. 1-8. The codes for the entire verbal expression would be: 1 
8 send/ 1-2 send.** if only a few words are said before the actual 
question Is asked, and/or are spoken very fast, thereby distracting 
you from concentrating on coding the question, only code the 
question. 

It is Important to code a 1-8 or a 7.-8 as soon as talk occurs, as it 
helps to account for the time spent in the tutoring sessions. 

*The respcnder is required to make a discrimination, however, the verbal 
express on Is not a question, as grammatically, it does not have a quem^ 
mark. (See pages h and 5.) question 

202 



189 



Categories TTj and QJ 

Category [T] ~" 

Exa=:ple5: "Ko," don't knov." "I von't." Ko response. 

■ * 

Category - Not codable 

Non verbal events are coded "not codable." Examples are behaviors, 
such as generalized disturbances, distraction, cutting, pasting, colorlrg. 
Interruptions by others, leaving the roo.. confusion or silence, writing 
words, and the like. 

It is Inportant to code the G as soon as it occurs, as it helps to " 
account for the time spent In the tutoring session. 
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Categories QJ and |T] 

Category [T]. ' ' 

Examplea: "No.- -i don't know." "I won't." Mo response. 

L- •' 

; Category jT] - Not codable 

Non verbal events are coded "not codable." Examples are behaviors, 
such as generalized disturbances, distraction, cutting, pasting, coloring. 
Interruptions by others, leaving the room, confus Ion or s 1 lence . writing 
words, and the like. 

It. is Important to code the 6 as soon as It occurs, as it helps to 
account for the time spent in the tutoring session. 



Ground Rules and Notes 

1. Let the context-of the lesson guide you. At times, a question might 
look Ukd a A. 5, 6, or 7 question, while the answer has just been given, 
or read during the tutoring sessfons. In that case you code Recall. 

2. Try to code every response, even If a series of responses Is given to 
one question. 

3. If a teacher asks more than one question without providing an opportunity 
for the student to respond to each question, code only the question the 
student does respond to. 

A. WhenJthe "Oh's," "I see's" and ••H;nm's,- etc., are distracting for coding 
other categories, neglect these. 

5. . If the shifting from verbal interactions (8) to non-verbal interactions (6) 
is too fast, then code only the significant shifts. 

6. When the time period after you code "5- for no response becomes substantial, 
then code a non-codable (6) until verbal Interaction resumes. 

7. A non-verbal response (sorting out, pointing to. picking up) is coded as 
a.recpcnse if it is the response the preceding question asked for. 

8. In the manual, most responses are more or less correct except for the 
obvious Incorrect responses on pages 17, 18, and 20. It Is . ■ ' 
important to realize that we are not interested in knowing whether an 
answer is correct or Incorrect. All we are Interested In is the klndof 
cognitive process required to respond to a question. So, a response can 

• still fall in the category as the preced Ing' ques tlon even If the response 
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Is clearly Incorrect. 



It 18 also Important to realize (so you don't get confused) that we are 
not mt^rest.d In the level of difficulty. Higher level questions, often 
are. but do not necessarily have to be .ore difficult. A Discrimination 
question can be difficult (e.g.. sounding out letters or words), so can 
a Recall question ("Wlmt is the chc.Lcal formula for vater?")l An In- 
ference question, on the other hand, can be easy ("What would happen If 
you spill a glass of .ilk on the table?") so can a Proble. Solving 
question ("What would you do if the phone rings?"). 
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APPENDIX G 

f Lesson Plan Format and Rating Scale 



\ 



So:' 



Module 2 



Writing Lesson Plans Required Guidelines 

The present contains descriptions of the Items to be included in preparing 
your lesson plans. Since they are arranged in Iv^Jzal, order for the 
development of lesson plans, it is a good idea l^eck the items and 
write your lesson plan in the order in which thej n ^ given. If you use 
this as a standard format in the preparation of co^iir lesson plans, It will 
facilitate evaluation and also make the feedback a meaningful for you. 

In addition, you will find a copy of the evaluation sheet that will be 
returned to you each time you submit a lesson. The scale used on the 
evaluation sheet is for your guidance in interpreting the evaluation - the 
scale points are not grades and will not be used as such. 
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CIinCKLIST FOR WRITING LESSON PLANS 



1. THE ENTRY TEST; 

The entry test should check the prerequisite skills the pupil 
needs in order to understand your lesson. If no special prerequisite 
skill is needed, mnr^tion that in your lesson plan. th ^ lesson 
objective is to \ the pupil how to write his na^ e., ycvi would 
ej^pect him to know h. to write the letters of the alj labet. Your 
entry .test will check if the pupil knows how to write different 
letters. The entry test does not test the attainment of the lesson 
objectives. 

2. TASK ANALYSIS: 

The next and the most important step is a task analysis. Of 
course, your lesson plan need not contain the task analysis, but 
unless you do it, your subobjectives may turn out to be irrelevant 
and your lesson plan incomplete* 
2.1 The Main Task is Analyzed up to Entry Level ; 

If the main task is to copy a sentence, the subtasks could be: 
!• Begin the first word with a capital letter, 
^. Lea^^e small space between letters in a word, 

3. Le^t^ve mcyt© space between words, and 

4. Place a period at the end of the sentence. 

We need not include the task of writing the letters as this is a part 
of the entry behavior and checked by the entry test. 
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2.2 There is no Unnecessary Subtask ; 

If the main task is for the pupil to write the name of his 
neighbor, do not ask the pupil to draw his neighbor's face and name 
him. Asking the pupil to draw may be a good idea to keep the child 
busy, but it is not a necessary subtask in order to perform^ the nrnin 
task. 

2 . 3 There is no Trivial Subtask : 

If the objective includes pupils' copying a sentence, do not 
include such subtasks as ''the child writes from left to right*' unless 
you have a very strong reason to suspect that the pupils have to be 
taught^ this. 

2 • 4 The Subtasks are Arranged in Suitable Sequence ; - 

In the example in item 2 tlie exact sequence of teaching is not 
important. But in some tasks mastering one subtask is necessary 
before the pupil can master another subtask. In such cases, arrange 
the subtasks in the correct sequence. . ' 

3. MAIN AND SIJBOBJECTIVES: 

The task analysis is transferred to the lesson plan in the 
form of subobjcctives. Write a subobjective for each subtask you 
have identified. Use the items 3.1 to 3.5 below to check your main 
objective and each of your subobjectivcs. 

3.1 The Objectives are Specified in Performance Terms ; 

"Know," "grasp" and "understand" are nonbehavioral terms which 
should not be used in writing these objectives. You may find the 
ALPHABETICAL LIST OF PERFORMANCE TERMS useful, (pg. 5) 
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3.2 The Objectives Contain Suitable Performance Range : 

Range indicates variations in the question asked of tkze child. 
•'Discriminan:e ben^¥'^»^^- the sounds of different letters*' doesis not 
contain th* amge. Yoni w/ill have to expand it to ''Discriminate 
between th^ ids k, n, t and d.". 

3 . 3 The 0 -tj rt; ves \ in Performance Conditions : 

You will Lave -^ocify what help is to be given to the 
child. If Johnny ma; look at his name written on tlie chalk boafd 
and copy it, or if yco will help him when he has difficulty specify 
this as a p^rt of yojr objective. If not, say "without help " 

3*4 The Objectives Coimtain Suitable Time Limit ; 

This is the amount of time you give Jolinny to write hi... i^amje 
(e.g., ''within two minutes''). This time limit is not to be coT^vfiii^ei 
with the thirty minutes class time for the entire lesson. 

3.5 The Objectives Contain Suitable Performance St Msj - 

If you want the pupil to perform without any error, write 
"without any mistake," or "with 100% accuracy." If you do not 
expect such perfection write "9 out of 10 items" or some other 
suitable standard. Another type of standard is to specify what 
the response should be. You want Johnny to use capital J,, and yam 
will not^accept aijy spelling mistake; but you do not mind if 
Johnny's writing is TTot perfect, as long, as it is legible. ' 

4. CRITERION TESTS IFOR MAIN AND SUBOBJfeCTIVES: 

No doubt your criterion test is built into your classroom activity. 

But the activities arte planned on your criterion test and not the other 

/ 

J? / . 
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way vc^armd. Therefore, please write them separately from your instructional 
eact.Tyitaes. 

• 1 Tlie Test is a Valid Measure of the Objective ; 

If Johnny is to write his friend's name, teach him to draw his 
friend's picture arid name it, if you want to. But do not build a 
criterion test around drawing pictures. The criterion test measure:; 
the objective, notliing more and nothing less. 

L . TmCIiING STRATEGIES: 

"he following items are often a matter of individual iu untr . 
^Md int -nion. Similarly, evaluations may be subjective jcp thiis 
rand v ^cn reacting to the evaluations. 

T he In:>tructional Materials l l^ rQ. are Appropriate to the Objective ; 

5 . 2 The Instructional Activities are Relevant and Appropriate to the 
Criterion ; 

5 . 3 The Overall Layout is Done with Care : 

5.4 Lessons are Well Planned for the Period of Activity : 
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ALPHABETICAL LIST OT PERFORMANCF. 



build 



read 

rocal-. 
recopnir ::r 
restate 



change 



classify 



cc^pare 
complete 



say 



'Jl5cr::ania^t^ 
•Ji^tinguisin 



tell 
test 



underline 




use 



rzll in 



vnrite 



ft nish 

^ ive 

identify 
imitate 

keep 

label 

list 

locate 

make 
match 

name 

organize 

plan 

question 
quote 



2VJ 



KA95 Spring, 19?fc 
Or. Sitko 

... ^DATE_ _Lesson Hio. 

^ iCkLuTT "CiR LESSON PU^li ) AlLUATION 



Entry Test 


NO 
1 


2 


3 





YES 

^5 


1.1 The entr>^ test ir suitable for 

entry level of the target stude . 


1 


2 


3 


4_ 


^5 


1.2 The entn- tv r excludes the lessen 
objectivrvj. 




2 


3 


A 


c 


Ta?k Analysis 












2.1 The main.tasl< is cMzlyzed into simple 
subtasks. 


1 


d. - 


3 




^5 


2.2 There are no unnecci;roary subtasks. 


1 




3 




_ S 


2.3 There are no trivin* subtasks. 


1 




3 • 


4 


s 


2.4 The subtasks are arranged in suitable 
sequence. 


1 • 


2 


_3__ 


__4_ 


■ 5 


Objectives 












3.1 The objectives are specified in performance 
temss. 


1 


2 


3 




S 


3.2 The objectives contain a suitable 
performance range. 


1 


2 


3 


__4_ 


s 


3,3 The objectives contain performance 
conditions, (equipments, aids, etc.) 


1 


2 


3 




5 


3.4 Tbe objectives contain suitable time limits. 1 


2 




_4_ 


S 


3.5 The objective contain suitable performance 
standards. 


1 


2 


3 


4 


5 
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- 


No 
1 


— 






YES 
5 


Criterion test for main and subobjectives 












4.1 The test is a valid measure of the 
objective. 


1 


2 


3 


4 


^5 


Teaching Strategies 












5.1 The instructional materials used are 
appropriate to the objective. 


1 


2 


3 




5 


S.2 The steps in teaching are relevant to 
the criterion. 


1 


__2__ 


__3___ 


-J*. 


S 


Si5.-The overall layout is done with care. 


1 


2 


3 


4 


5 


5.4 Lessons arc well planned for the period 
of activity. 


1 


__2__ 


__3_ 


4 


5 
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Pre-Post Standardized Assessment of Pupils 
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Pupil 01 



I. Math 

A. Key Math 

B. WRAT 

II. Reading 

A. Survey of Primary Reading 
Form comparison 
Word form comparison 
Word recognition 
Sentence recognition 
Sentence comprehension 
Story comprehension 



B. 



E. 



Pre 



Pre 
71 



Pre 

6 

14 
17 
S 
6 

0 



Post 

2.1 + symbols, add., subt., time 
- mult., wd. problem 

Post 
2.2 



Post 
6 
14 
17 
8 
9 
19 



Pre - range of basic vocabulary in sentences 

Post - comprehends directly stated facts (not yet ready for iniferences) 



WRAT 

Spelling 

Reading 



C. Dolch Word List 



D. Gates -MacGintie 
Vocabulary 
Comprehension 



PPVT 

Percentile 



Pre 
2.6 
Pre 

m 

83% 

Pre 
Tl 
1.4 



Post 
2.9 
3.0 

Post 

100% 

Post 

2.2 

Post 

65 
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Pupil 02 

Math 



A. 


Key Math 


Pre 


Post 






TTT 


3.7 




B. 


WRAT 


Pre 










2T6 






Reading 








A. 


Survey of Primary Reading 


Pre 


Post 


Max 




?onn cos^arison 


"To 


"TT 


"T? 


- 


Word forci comparison 


10 


14 


14 




Word recognition 


11 


17 


17 




Sentence recognition 


6 


8 


8 




Sentence comprehension 


4 


6 


9 




Story comprehension 


18 


read to 14 


indep, 28 




Pre - basic vocabulary and use of vocabulary in sentences 




Post - 










WRAT 


Pre 


Post 






Reading 


Te 








Spelling 


1.4 


1.5 




c. 


Dolch Word List 


Pre 


Post 










ToT 








24% 


48% 






Gates -MacGin tie 


Pre 


Post 






Vocabulary 


1.6, 


1.6 






Comprehension 


1.5 


1.6 




E. 


PPVT . 




Post 






Percentile 




6% 










80% 






Alphabet ID 


Pre 


Post 








"1^ 
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Pre 


Post 






3 , y 




Pre 


Post 




2.4 


3.2 




Pre 


Post 


Max 


TT 


"TT 


IT 


14 


14 


14 


11 


14 


17 


6 


8 


8 


6 


7 


9 


12 


18 


28 



Pupil 03 

I. Math 

A. Key Math 

B. WRAT 

II. Reading 

A. Survey of Primary Reading 
Form con^ arisen 
Word comparison 
Word recognition 
Sentence recognition 
Sentence comprehension 

♦Story comprehension 

♦All stories read to him 

Pre and post in area of use and meaning of words in context 

B. WRAT Pre Post 
Reading; wouldn't attempt 2.3 
Spelling 1.5 1.5 

C. Dolch Word List 



D. Gates -MacGintie Pre Post 
Vocaburary 1 .5 1.6 
Comprehension 1.6 1.5 

E. PPVT Post 
Percentile 3% 
IQ 72 

F. Alphabet ID Pre Post 
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Pupil 04 




B, WRAT 
II. Reading 



A. 



B. 



Survey of Primary Reading 
Pom con?) arisen 
Word comparison 
Word recognition 
Sentence recognition 
Sentence comprehension 
Story comprehension 



Pre - use and meaning of words in context 
Post - comprehends directly stated facts 



Pre 


Post 




- 


4.2 




Pre 


Post 




3.6 






Pre 


Post 


Max 


-n 


"TT 


-IT 


14 


14 


14 


.16 


16 


17 


8 


7 


8 


8 


8 


9 


11 


21 


20 



WRAT 
Reac 
Spelling 

Dolch Word List 



Pre 
1.8 
Pre 
72% 



Post 
2.9 
Post 
86% 



D. Gates-MacGintie 
Vocabulary ~ 
Comprehension 

E. PPVT 
Percentile 
IQ 

F. Alphabet ID 



Pre 
1.6 
1.4 



Pre 




Post 

Too^ 



<:2n 
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Pi^il 05 



Math 



A. Key Hath Pre Post 

2.0 2.5 

B. KRAT Pre Post 

■ 2.8 3.2 

Reading 

B. WRAT Pre Post 
Reading TT TT 
Spelling 1.2 1.6 

C. Dolch Word List Pre Post 

44 69 

20% 31% 

D. Gates -McGintie Pre Post 
Vocabulary no attcapt 1.6 
Comprehension no atten^jt 1.5 

E. PPVT Post 
Percentile §4 

IQ 77 

F. Alphabet ID P re Post 

missed missed 

d, V, h, G, Y, J 

j. ai gi 
H, J, V 
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PuDil 06 




B. WRAT 



II. Reading 



Pre 


Post 






"O 




Pre 


Post 




t:^ 


TT 




Pre 


Post 


Max 


12 


~Tr 


-IT 


12 


14 


14 


16 


17 


17 


8 


8 


8 


8 


8 


9 


3 


22 


28 



A. Survey of Primary Reading 
VoTTL comparison 
Word conparison 
Word recognition 
Sentence recognition 
Sentence comprehension 
Story comprehension 

Pre - basic vocabulary and use of vocabulary in sentences 
Post - comprehends directly stated facts 

B. WRAT Pre Post 
ReacTing ITS' 2.3 
Spelling 1.5 2.3 

C. Dolch Word List Pre Post 

62% 71% 



D. 


Gates-MacGintie 


Pre 


Post 




Vocabulary 


TT 


TT 




Conrprehension 


1.4 


1.6 


E. 


PPVT 

Percentile 
IQ 




Post 

6^ 

76 


F. 


Alphabet ID 


Pre 

TooK 


Post 
~i"5o\ 
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Pupil 07 

Pre Post 

Pre Post 

Pre Post 



C. Dolch Word List 



D. Gates-MacGintie 
Vocabulary 
Comprehension 

E. PPVT 
Percentile 
IQ 

F. Alphabet ID 

Letter recognition: confuses Y, U, S, C 
Nota Bene : Richard was withdrawn from the school as of May 2nd. 



I. Math 

A. Key Math 

B. . WRAT 



II. Reading 
B. KRAT 



Pre 
17% 



Post 



Pre 

rr 

1.6 



Post 
1.7 



Post 



Pre 



Post 
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Pupil 08 

I . Math 



A. Key Math Pre Post 

. TT "Tg 

B. WRAT Pre Post 

2tT 2.8 

II. Reading 

B. WRAT Pre Post 
Reading T.3 1.5 
Spelling 1.2 1.5 

C. Dolch Word List Pre Post 

IT "~36 

10* 16% 

E. PPVT Post 

Percentile 1\ 

IQ 73 



F. Letter recognition 100% 

G. Boaha prob. concepts between 

whole 
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I. Math 

A. Key Math 

B. WRAT 
II. Reading 

B. WRAT 
Reading 
Spelling 

C. Dolch Word List 



E. PPVT 

Percentile 



Pupil 09 



Pre 



(K-A) 



1.6 
K-1 

Pre 
36 
16\ 



Post 
"T5TT 



Post 
44 
20% 

Post^ 

57 



Pre 



Post 
did not 
know r, q 



F. Letter recognition 
G* Boehm prob, concepts^ 
H. Pupil can now follow verbal directions and use siraple answer sheets. 



through few 
next to widest 
inside most 



between behind 
second row 
several after 
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Pupil 10 



I. Math 

A. Key Math 

B. WHAT 

II. Reading 

A. Survey of Prinary Reading 
Form conparison 

Word comparison 
Word recognition 
Sentence recognition 
Sentence coiqprehension 
Story coziprehenslon 

Pre - use and laeaning of v 

B. WRAT 
Reading 
Spelling 

C. Dolch Word List 



D. Gates-MacGintie 
Vocabulary 
Conprehension 

E. PPVT 
Percentile 
IQ 





Po<;f 










Pre 


Post 




TT 


4.7 




Pre 


Post 


Max 






"TT 


1 A 


1 A 


14 


1 

1 o 


X VJ 


1 7 


7 


7 


8 


8 


5 


9 


D 


1 ft 


9ft 


s in 


context 






Post 






«b • X 






1 8 




Pre 


Post 




96 


-no 




44% 






Pre 


Post 










1.6 


1^4 






Post 












79 





Alphabet ID 100% 
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APPEraiX I 
Module 3-A 

Interpretation of Printout Feedback w/' Scope 
K495 Practicun in Readimg 
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ceaigned to proviae the cec^c er cra--e»r c. jCn; i:^*-^ aut 

hlF/h«r Individual j-acierr* ji is- -tiier:-: ^^2:e::!i5= ; •i'^.- a 

i^iven lesson. Tie ^yB.er. .isct .rai-ec 'ier,^* ..r.^i Cser . w-ic l::;?^..^:. 

The data they obtain ic tr^-nsTitcted lae to -juscec ir c.nf#>* :,,>t 

as it is mechanically funchec I:: on ih? ^-utcon-bcjx) le -:D'>jpjtar t .^n 
tranSTilts the infciTft ion cbte^'k'^-- f'r-; cl-e roder i ito o d^ta storsg*/ file 
tor later use, or it arely^ee the data anci t^>€:.'s it b3:!< to t ie ic ^er - a so 
in' ■•real tirsc 

Tn the present e o£ CA'VS. wf -^-raLl tht- cjt» iter to jerfon 

botn thesn function^ Tit? ^^Ia that Is w. : v^ll be etrlev^d and prinCe.J 
out so th«t each tr-j^c'rvr :£?,fjv it and . e e.\ cbjeccive picture of 

his/her individual use of ri; --'erert te.^chi>' _ iacc-,ie*; represented iy encr^ 
of the categoriac oa tie 7ejr:v:ne.^ ^jp'i Cues in,i Xe?:/Ci^"*i S^Btieoi, 

You are to RT^pl iy thio urtpto. t *eedb.Tici: rui ,^?na^; ^iog pupil rtsponsea 

and your questioning »t rr»tev- l'f!s, ana : .c. jj:- ^ tiv,,- res i wtlng untl/sxa ro 

fornulate go3i> for your next IfSfior 

Tout:' first major tons of feedback for thla practlcura la CATTS acope 
feedback. A monitor will be placed In 3rour tutoring booth, (See Figure 1 
for a diagram of acope feedback.) 

As you tutor, the scope monitor will give you Instantaneous feedback 
on the number and types of questions you have asked. Also^ the number of 
appropriate pupil responses will be shorn. (See Module 17 for a complete 
explanation of hov the scope works.) There vUl be a moving ersrov under 
the abbreviations for the levels. The arrow will point to the cognitive 
level St which you should be questlonnlng at that point In the lesson. 
(Page 3 of Module IV gives the rules for arrow movement.) After you sue-* 
cessfully complete that cognitive level by asking an appropriate question 
and receiving an appropriate pupil response^ the arrow will move to the 
next Indicated question lovel. 
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BCAHPL2 O? CATTS PRUTmUT SKEKT 



E495 



1) TMchftr: 
2J rupLl: 



Date: 
TIm: 



Session length: 



Qvutioe 
2) Itval 



4) IBC 

s) 8-r 

6) 8R 

7) XW 

8) ft 



f) rr«q. 10) Vnq. 11) Fr*^. B«r Gritph (#-?; *-App. R«s.) 

20 30 40 

X 



z 

X 
X 

z 
z 
z 



z 
z 
z 
z 
z 




« « 

13) fmre«Dt high Icr^l tMcb«r ^Mtloot ov«r the total <(tttstlon8 asked 

• xxX 

14) FereeoC high Irvol pupil respoofet over the totel respontet g Ivec 

- MX 

15) Matrix 1: Teacher qtoeetlone bj iBdieated qacstloa level 



16) Indicated ^Metlon level 

wc uc 8-p B& ur 



P8 



TCBl 

QOU. 

MC 

UC 

8*P 

III 

IHT 

Pf 

ToUl 



17) Total teadMir qtteetlooe - ' 

18) Percent appropriate Mtehee • 

19) Percent queationa - higher than indicator > 

20) Percent queationa - lover than indicator • 




Total 

X 
X 
X 
X 
X 
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2i K*trlx 2: T«ach«r quMtlotu by pupil respoQacs 
^CHI. Fupii Rcspouta 




Total X X XXX 



fia Total tMchor ^u«stloo-pupll ro«pooits - 

^3PorcMt apptopriato Mtehct ■ 

9<yParcant quastloot hlghar than reaponce - 

afTarcaot quaatloas lovar tbjn refpcate ■ 

. ^ ^6 XPQt iBtexactioQ Sequancc Suonsry 

FraqiMQcy Dlttrlbutloa of Intaractlon Strings 

J 2 3 ^5 67ft 24 

^ » ^ XX XXX 

57 Maao string ■ 

ft;^MtdlaD atring - 

a?S.D. of atrins - 

90 Muabar of strlnga • 

3i liuabar of cooplatad aaque^at (to PS) ■ 

Parcant eoaplatad saqueocat (to PS) ■ 

J3Kuabar of codas • ^ 



iDdicatad Intaraction Strlnss 

U^l 

2) 50 32 42 T3 50 T2 P2 

3) 18 33 44 60 T2 P2 13 P3 

4) 

It 

Iff 
If 
tff 
II 
Iff 
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ttodalm III %U95 Dr. Sltko 

CATTS Priatout £«7 

(1) S ^atui^ data ; Thl« Inforiiatloo ideotlfle^ the printout by telling 
the reader who did the tutoring (teacher) » vho was tutored, (pupil), oa 
vhat day <date), at vhat tiae <tiae}, aad for hov long (aessioa length) • 

(2) ^ Tefcher Queatl^o n level : Teacher queetioaa are characterised aa a 
coQtlnuua ranging fro-n lover level to higher level depending on the cog* 
aitive proceasea that the question requires one to use in foraulating an 
aosver. <See Hodule Z) 

(3) BSC ; Discrimination 

(4) tSC; Recall 

(5) £iP: Sequencing - Paraphrasing 

(6) HR; Hierarchical Relating 
Oy Jiff* Inference 

(8) re: Problem Solving 

See isod'ale 2 for a complete definition of these levels nuabera (3) - (8) . 

(9) jfttEQ : This colunrn indicates the number of tines each Ifivel of question 
is aaked by the teacher r 

(10) gR£Q ; This Is frequency divided by the total nunbor of questlone. 
(see nufiber 17 for the total nuoiber of questions) 

(11) gREQ. BAR GRAPH : This Is a graph of the nutsber of teacher quest Ions 
at each cognitive level (designated by #) in the TPQR Observation Syatest 

and the nuaber of pupil responses at the saaie cognitive level as the question 
aaked (designated by *). Pleaae note that pupil responses on a cognitive 
level different fzoa that of the question asked are not abovn on the bar graph« 
*(12) Percent teacher questions : The X of TQ is the nui^er of questions 
the teacher asked divided by all teacher behavior (-that ia» the sum of all 
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tMcher quMtloDO plu«, all teschor responsM to pupil questions pliis all 
otbar taacbar talk (Sm TFQ& Observation System) • * Tour first major goal 
for the practlcum Is to keep your percent teacher questions bstveen 30% 
to 501/ 

**(13) Percent high level teacher questions over the total questions asked: 
Blgh level teacher questions Include Sequencing Paraphrasing^ Hierarchical* 
Relating, Inference and Problem Solving. **your secondary major goal Is to 
maximise the percentage of High Level Questions you ask relative to the 
percentage of Lov Level Questloos asked (e.g.» Discrimination and Recall 
Questions.) 

(14) Percent blgh level pupil responses over the total responses: Hl^ 
level responses Inclnde Sequeaclng«*Paraphrasing» Hlerarchlcal*Kelatlng, 
Inference and Problem Solving. 

(15) Matrix 1: Teacher questions by Indicated question level: Sea 16*20. 
♦**(16) tedicated Queetloo Level ; Your ghlrd major goal in your tutoring is 

to develop tba skills required Co ask In sequential order the tot^l hierarchy 
of six questions on the TFQR system and receive appropriate pupil responses* 
to each of these types of questions. To achieve this goal In each V^sson 
you must ask questions beginning at the lovest cognitive level (discrimination) 
and sequentially continae up the hierarchy to the highest level (Problem 
Solving). 

In order to help your pupil develop higher cognitive processes^ you 
should lay an appropriate foundation for the pupil. This can be achieved by 
starting out on the lesson content asking discrimination questions yid getting 
the appropriate responses from the pupil. You should continue asking 
questions at the discrimination level until the pupil gives the doalrad 
response. Similarly » you should follov this procedure at e&^ch level on the 



TPQR 5iy9t«Bi an Indicated by the nrrow oq the CATTS Scopft. For exanple, 
usume the pupil Id lu the middle of reftdlng n story, you caay ask point Is&g 
to A picture '^WhAt Is the Hon doing In this picture?'' ( e dlscrlniliuitlon 
question) Continue here until you ere confident that the pupil understands 
your question and gives an appropriate discrimination response. Then ask the 
pupil to recall ^hat happened on the preceding page (a recall question) « 
Continue in the manner described above, then aske the pupil to retail the 
etory up to that point in his/her ova vords (sequencing^paraphrasing question)* 
Continue as above, then ask the pupil to explain vfay it rains (raining in 
the picture) ( a hlerarchlcal*relating question) then ask the pupil what 
ha thinks vould happen if the lion left the forest and vent to livis in the , 
soct. (an Inference queetioa) Piaally, as the arrcv moves to problem aolvlng, 
akd the pupil %rhat vould she do in a new place to make nev friends. Please 
nota that if you think your pupil Is not following the lesson plan, do not 
be afraid to drop back to a lower cognitivn le\-el in order to help your 
pupil to a better understandlag of the story. 

In axemlnlng Metrlx I, the most Important feature to note is the diagonal 
as indicated by segment B. This diagonal will show you the number of ^'hlts*' 
that you have made. A "hit" occuvs each tine you ask a question at the 
same level indicated by ttte arrow on the CATTS scope. 

Segment A gives you the instances where the indicated question level 
on the CATTS scope was higher than the actual question asked. For example, 
if the indicated queetlon level is Sequencing-Paraphrasing and you ask a 
discrimination question, then a "miss^ will occur in segment A. (A *^sisa" 
menaa you have not asked a question at the indicated question level) • 

Similarly, segment C gives you the Instancea where the indicated question 
level was Icw^r than the actual question asked. For example, if the indicated 

question level la scnM^^^iDg-paraphraslnn and you ask an Inference queetlon. 
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th€0 « "rIss" will occur Im scgtaent C. 

(17) Total teacher qutefclonfit « (A + B C). 

(18) Peycj^nt appropriate cMtcheg; Total auaAer of "hits" divided by total 

B 

Dusber of teacher questional I.e. , (A + B + C) . 

(19) gexcent auegtloaa hlgber^hAn, indicator : C divided by total teacher 

C 

queatloaa I.e., (A + B + C). 

(20) yer<s j | i |t gueetloae loifer than indicator; A divided by total teacher 

A — 

quaatlooa l.e.^ (A + B + C). 

(21) Matrix 2; Teecher g^estloos by Pupil Response. 

Tour fourth aalor goal in your tutoring is to obtain appropriate pupil 
reaponses to cognitive questions asked. For InstaneOp If you ask an Infer'* 
ence question^ you should expect to obtain an Inferential iresponse froia the 
pupil* Matrix 2 provides feedback vhlch Indicates your efficiency In <^talnr 
Ing appropriate responses or tsatcbeg to your questions. 

In exaailnlng Matrix 2» the wont laporCant feature to note is the diagonal 
as Indicated by segnent S, This diagonal wlll^shoif you the number of 
^'appropriate Mtches*' nade. An "appropriate aatch" occurs each tiflS you 
c^aak any question In the TPQR hierarchy and the pupil responds at the aaoA 
level; The nuabers In segaent D give you the Instances by cognitive 
level vhen the pupils response to a teacher question was et a higher ttogaitlve 
level In the TPQR systea than the question asked. For exaflq>le» if you ask 
a aaquenclng*paraphraslng question and tbs pupil responds vith an inferential 
reaponae, than an inappropriate response will occur in segnsnt S« 

Siallarly* the nu^eni in segaent F give you the instances by cognitive 
level when the pupil response to a teacher question vaa at a lover cognitive 
level in the TPQR systea than the question asked. For exaaplep if you ask 
an Inferenclal question and the pupil responds with a recall response^ k 



. lis 

th^a aa Inappropriate rasponse will occur In oegoeat ?• 

(22) TPti^lJaayhtr^M^PUS^^Aip^l to ° D + E 4^ F. In Hat|rlx 2 
that ls» tha Grand Total of Teacher Queatlons and FuplI Responses which 
occurred during the lesson « 

(23) Fjirgant Ap prp priate^Mstches - The total nuBd>er of appropriate natchaa 

t 

divided by total Teacher Question » Pupil Responses » D 4- B + F. 

F 

(2*) Percent Queatjooa hiahar than Response « D + B + F 

D 

(25) Percent 9^^*^^-^^ J-p yj^?— ^^W?-^^J?Pgggj^ • D + B + F 

(26) TIQBJlnterectjLpn Secy u ence Sttosaar^ 

At the beginning of each lesson, you are expected to start asking 
quastioos at the cognitive level Indicated by the arrow in the scope. This 
tmld be the dlscrioinatlon level. (Please Mfer back to the rules for 
arrow aoveissnt in the explanation of the scopa display). 

If you asked a question at the cognitive level indicated by the arrow 
and the pupil responded at that level, then a new line on the printout would 
have begun, (Note! Bach line on the printout la called a string) and the 
arrow would have noved up one level to the right on the scope. When this 
occurHfed you should have then asked a question at (he next cognitive level 
indicated by the arrow. However, if your question and the pupils appropriate 
reaponse were at any other cognitive level than that indicated by the arrow, 
there would be no change in the arrow poaition. Note, if 3 consecutive 
queatioits are asked at tfas cognitive level indicated by the arrow and no 
appropriate pupil response is given, the arrow then drops back one lavei to 
the left and tba string ends. If the arrow raacbes PS (Problett-Solving) and 
tba appropriate question and response are given, the string ends and the 
arrcsp will nove down to the level of the naxt lower question asked. Note, 
the above does not apply to pupil questions and teacher responses. 
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(27) Me^ Stvtog - total domber of bohflviora (codo/O/ ^otal number of strings 
<8e« 30). 

(28) Mad Ian gtrlnR 

(29) Standard De v iation of StrtnR 

(30) Nuabar of Strings 

(31) Nuqber oi Cocapleted Soq ucncas - nuniber of tloaes that you have ouccaaa* 
fully cotoplecad tha 8equai:ice from dlacrlminatloa to problem solving. 

(32) Parceot Corolated Sequences - Nusber of completed sequancaa divided 
by nunbar of strings (#31/#30). 

(33) Hucgbar of codes " total nuitber of behaviors 

(34) Interaction Strtpg Ust - the cowpletc list of all behaviors in the 
leaaon in chronological order. T'-l, P»2. SO indicates a no raspoosa 
vaa given to the prior (not shovn) teacher question. 
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GraphleaL Analysis of GAITS - Printout 

Bach tutor vlll h% givmn a pcMfh^ot his bmstlins behavior (without 
faadback) for ^^prosiwitoly tan lassona. Thasa graphs (saa Bxaispla -) 
mil ba Ilka graphs of tha parcaat hifh*laval taacher qusstlcms (labalad 
ratio 2) and tha parcaat ^hlgh Irral pupil rasponsa, (labalsd ratio I)« 
Xha a-eoonllaata as ohiwa is tha aaaaioo ousibar (sasslons ara in ehrooolog* 
leal ordar) aad tha yooordiaata la parcaat. 

Baoh tistor will ragrapb tha inforaation on the providad graph p«por* 
la addition, aftar aaeb laasoot tha tutor vill graph tha saM ratios as thay 
appaar oo tbair printoot ahaats aa noabars 13 and 14 (saa GAITS - printout 
kay for fortbor axplanation). Haaaa f.odicats by a solid 11ns aad K2 
by a dotted lina^ so that tha graphs aay ba aasily cooparad. 

Idaally» tj^ and Bj should ba approxioataly parallel. Plaasa do not 
griph any laasoo that has favar than 10 quascioos. 



APPENDIX J 
CATTS- SCOPE Feedback 
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ModuU IV 

CATTS-SCOn i?t«do«ck 



K 495 



Fo.rtitflng c.x,,r«h<in«l,r:, U.„on,. the .AT:; vidtc moof..; { r, 

th.t chnnj.. « ,0. .ueuetcc Ch. ^tu.^nt. r.e ..r graph ^,11 .l„v ,ou 
vhlch ,.«t>a ,ou h.v« th.t a«n.-.nt «nd ,Ue relatl.nahi^ . 

b«.:v*t«o u.e of tn, clff^r^at qut.tic* to ea. h other 



10- 



-^c s-p KB ntp PS 



Ing 6lx quettlor f.Ptep.orici 



tfJi-JX-loriii: .i« you rt.*Bt:.c,s the coder tran3m?tH th» ccMe for f» 
qu^.tl,.: to Chi c-..v<.tor. which Ui.a InttaatJ - ,h.«.- itn occur<.nc. b;, 

th. bzr lor th*C q.^.tt,,. cp « .otch. Wht. you f.rst stert y..u. 
Iwioa tb. b.t. are £l.t .lc.« a hcri.ontaX and the number, ten 

«howa ..t top of the vertlc*. („ot .c.ll, aee.). ... . ,„„uion 

occur., tu. b.. ri.e. « coa«t4;nt a.«n,nt for e,:ch occu,.«pc.. A bar h.lf- 
V.2 .p ta« ...le t.Us you th.r. have be., five u^rMon. for the cteg.r, 
re|.r«aenced hy th*r. bar. 

That. vllJ. be « .rro.. -c.rtl.^ ..t DSC tc sha. tne Indicated ^ue^ttoa 
th. «c««n': of «hlch vlU ."oJ'cv the rule dccrlbcd after Ux^tople 
3. Tb. number u. tb. upper right . ..^d corner tl-.e ,..rc.n.t tc.chn 
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36% 


DSC 


r~ ~ 
JU 
R£C 


LT' 
S-P 


L" 

HR 


r -i 
1 1 

in7 





Exaapl* 2 

lo ExMpU 2, you cab tse thht there hrive bued flvt IKP que»tlon«, 
•bout 7 cr 8 PS qu«*tloiu ••k«d mr.d two HR queitlons asked. The x'e 
lodtctte pupil r«cptm««s at that Uv«l. In Exaaple 2, there was one 
DtC reapoBM aod three P8 respooa«s. 

As the bar for any category reaches ten, the display will cut off 
for a wMBCnt and then reappear scaled down by oae-h«lf. A 20 will show 
on the vertical axis in plae« of the 10 and each bar will be half as tall 
as it was bafore. See tfi 3. 
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36.; 



I 1 



I I 
I i 
I I 
i I 

Ix I 
fx I 
Ix I 



,'JL.I iaJ li-l _ JL2L.»LiJ 
DSC K2C S't HR INF PS 



36X 



i I — 
I l| I 



I i 
I X I 

I ! LjcJ I I 

DSC REC S-P HR INF PS 



Ix I X I 
U I X I 



Ten Scale for baginning p«>rt 
of r\«ssoo. 



Twenty scale used after any 
category reaches ten. 



lxaiq>U 3. Change in scale after ten questions in any one catepory. 

!n order to help you co^>lete the hierarchy by moving the arrow for 
the indicated qnestloa level to the right, here are som rules for aeve- 
«tnc of tb« arrow: 
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At thi. iitg.uulni oif ti- -.en, tlis p^fow t:".l Vl CS>C. 
(Airo* oaa tlcn IncJl -.ti i-.l <iu«ptti)r '..weL). 

l«srl, rhei. th« •rnvtil ,<v* tas inyt htp^er ".•vel. 
lE tlw .jj«r.tl.3u trid th* t . ..mh; ..re , the sire- i."..-! „ji 
alghai or i«*uv tUvt i;b* . <:icic«c iier.t < ^n l-vjl. th*n tKeic 
la a> cl-.iioge In tht irrow bj.;;i.c 

If ch« oti^htUire i^r^d th« r . >. .r. at 3 at Uf'-fint ».ev«lj, ot.: 
^hJ qu«. cirn ?.a the loo .rated qu.?Ptl^: r;iea. after r , 

ocoar. ! U-vf tliKsr. th« a;; c^. -..i. tlon :'.croa',CK 1., th* l*);r . 
It th« 'uoitlon .Kd f;Uf ra ti c.t< 0. nre ar dlf (irj .-ent lev*!.:, ,,c,J 
r.hn cju*rif.tcQ i« «lo'i« ot t,i )i:K .h,. ittdl ste.! ^v;«at: ou Invel, vv. 
i;>4'jr* cm i!c ci.aiiHT ,'.11 f \t i.i . : \Hsi .li: .. 

£f Cl.a <u«tttcn n&d r.^e ,-, ,.^cv cr , «t ct;; .«^v«;> j.r..'. t.u;. 

itva H proM«m solvlKj n>>, M.eo .h^; „rrc.w ra;;urn8 to -he 
l.tv.|J jf tha taxi: l.u + l ri.;'.:r' .i;,esr.i or,. 
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Plfiuro 1. ArrangcBont of Laboratory Classroom for CATTS 
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APPENDIX K 
Module 3-B 
Interpretation of Printout Feedback 
K495 Practicum in Reading 



215 



234 



As Indicated in Module I, the CAITS system of tescher training Is 
designer to provide the teacher ?:rainea with objective information obour 
his/her individual pattern or use of different te.achlr:? strategies during a 
given lesson. The system uses trained classroom observsrs co cc^e lessons. 
The data they obtain is transmitted to the coiiputer in "real tif^^a" (as ifoon 
as it is mechanically punched in on the button-box). The computer then 
trana-nits the infoniation obtained frora the coder into a data storage file 
for later use, or It analyses the data and feeds it back to the ;;cacUei: - ale 
in "real time." 

In the present use of CATISe we shall use the computer to perforTi 
both these functions. The data that is stored will be retrieved and printed 
out so that each teacher can review it and have an objective picture of 
his/her individual use of different teaching strategier (represented by each 
of the categories on the Teacher Pupil Question Response System. 

You are to employ this printout feedback for aaalyslng pupil responses 
and your questioning strategies^ and then use the resulting analysis to 
fornmlate goals for your next lesson. 



2 16 
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BXAHPLB OF CATTS PRINTOUT SHB£T 

TPQR 
K495 



1) Teacher: 
Pq> 11: 



Tftacher 
Quest loa 



Date; 
Tine: 



Session Length: 



2) level 9) Freq. 10) Wreq. 



3) DSC 

4) REC 

5) S-P 
6} HR 
7) IN? 
8} PS 



X 
Z 

z 
z 

z 
z 



z 
z 
z 
z 
z 
z 



11} Freq. Bar Graph (#-?; *-Apif. Res.) 

0 1 0 20 30 40 50 



I #### 

\ *** 

###### 



12) Percent Teacher Questions ■ xxX/ 

13) Percent high level teacher questions over the total questions askedmX 

14) Percent high level pupil responses over the total responses given 
" XX X. 

15) Matrix 2: Teacher questions by pupil responses 



TCHR. 






QUEZ. 


OSC 


DSC 






RBC 






S-P 




X 


HR 




X 


INF 




X 


PS 




X 


Tctal 




X 



REC 8-P HR INF 



PS 




Total 

X 
X 
X 
X 
X 
X 



16) Total teacher questlon^pupl 1 responaes - 

17) Percent appropriate Guitchea ■ 

18) Percent quest lone higher than responae »> 

19) Percent questions lower than response « 

2$) 



TPQR Interaction Sequence Suanary 

V 8 3 » 5 ■■ fl y . 8- — 
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21) lfe*n atrlng - ____ 

22) fedUa string « 

23) S.D. of string « 

24) Ruoaber of strii?g« • 

25) Nudber of completed sequences (to PS) 

26) Percent completed sequences <to PS) ^ 

27) Number of codes » 



28) laterectlon Strings 

50 32 42 T3 50 T2 P2 

18 33 44 60 T2 P2 T3 P3 



r 
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Module k/^'.'S Ur* Sttko 

(1) Stat>.;?^^t^ft; This irforrrr^t: Ion Id^ntiflea thr printout by telling 
the ve«ciar uho did the tutoring Ctearher)^ who was tutored, (pupil), on 
vhat day <date*, at vhat tine ^tina), and for how lorg <siC8sioa length) i» 

(2) Teacher 9_ug ;»^i^9 '^ Leyei : Xeacher questions are characterized as a 
contlouuoi ranging froT lower level to higher level depending on the cog* 
nltlve procaaaea that the question requires on^ to use In formulating an 
enaver. {See Kodule 2) 

(3) DSC; DlF::rlffilnatlon 

(4) RKC: Recitll 

^5) S^F: Sequencing * Pnrapliraslng 
(6) Hierarchical ^^A^tlt^^ . 

^^J* Hoference 

(8) Probletii Solving 

See module 2 for a complete deflnir. on of these levels nu.Tibers (3) (8) « 

(9) FB&9.^ This column Indicated the number o£ tiroes each level of queatloa 
la acked by the ^zeacher * 

CIO) XFRE§,: This Is frequency divided by tho total number of queatloaSo 

(see number 17 for the total nunber of questions) 
(^^) gREQ* BAR GRAPH : This Is a graph of the number of teacher ^li^estlona 
at eaich cogi^ltlve level (designated by #) In the TFQR Observation Systen^ 
and the numbc of pupil responses at the same cognitive level as the question 
asked (designated by *). Please note that pupil reaponaea on a cognitive 
level different from that of the queotlon asked are not ahovn on the bar graph. 
*(12) Perce nt teacher questions ; The % of TQ is the nutsber of questions 
the teacher asked divided by all teacher behavior C*that is. the sum oC all 

2-J.9 , ' 
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teacher questions plus sll Ceechsr resp':)as«s to pupil questions plus all 

9 

Other teacher talk (See TPCR Observation Sygteo)- *Ycur flrat major goal 
for the practlcun is to keep your percent teacher questions l)eti#eeii 30Z to 50Z, 
**(13) Percent high level teacher quectlons over the total question* asked: 
High level teacher (faestions include Sequencing ParapTirasing , Hierarchical- 
Relating 9 Inference and Problea Solving. ^Tou:r secondtf^ xaajor goal is to 
T^axinlse the percentage of High Level Questions you ask relative to the per-* 
centage of Lov Level Questions asked (e.g., Difw:rl2xdLnation and Recall Questions.) 
(14) Percent high level pupil responses over the total responses: . High level 
responses include Sequencing-Paraphrasing, Rierarchical-4lelati2icV Inference 
and Problem Solving. In addition to naxlaizing high level questlonSy your 
third najor goal in your tutoring is to develop the skills required to ask 
in 8«q[uential order the total hierarchy of six qtiestlons on tha TPQR syatsa 
and receive appropriate pupil responses to each of these types of questions. 
To achieve this goal in each Iea.^n yen oust ask questions beginning at the 
lowest cognitive Issrel (discrininatlon) and sequentially continue up the 
hierarchy to the highest level (Problm Solving). 

In order to help your pupil develop higher cognitive processes, you 
should lay an ai>propriate foundation for the pupil. This can be achieved 
by starting out on the leason content asking discxrlaination question and 
getting the appropriate response fron the pupil. 7ou shotild continue asking 
questions at the discrimination level until the pupil gives the desired 
response. Slailarly, you should follow this procedure at luich cognitive 
level in the Ij^QR systan going up the hierarchy frosi discrlalxiatlott to 
problsB solving. 

For exsasple, assuae the pupil is in the middle of reading a story, 
you may ask pointing to a picture ''Wliat color is the lion in the picture?" 

• ^5 J 
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(a dlscrliaituitlon qucs^tlcm). Continue at this cognitive level vlth similar 
(lueatlons until you art confident that the pupil uaderstands your question and 
gives an approprlace dlscriainatlon responsts. Then ask the pupil to recall 
irhat happaned on the preceding page (a recall question). Continue in tha 
aanner described above. Then ask the pupU to retell the story up to that 
point In his/her own vords, (A sequenclng-paraphrit^ins question). Continue 
89 above. Then ask the pupil to explain vhy it rains (assume it is raining 
In the picture) . Then ask the pupil vhat he thinks vould happen If the llxm 
left the forest and mmt to It^e in the seoo (an Inference question). Then» 
ask the pupil what would s/he do in a nav place to make xxmu friends. 

Please note that if you think your pupil la not following the laaaon 
plan, do not be afratld to drop back to a lover cognitive level In order to 
help your pupil to a better understanding of the story. It la laportant to 
ask your queatlona In the fona of a quastlon as described In Kodule TPQR 
Observation Systen, pages 4-5. 

(13) Katrix 2; Teacher questions by Pupil Response . 

Tour fourth major goal in your tutoring la to obtain cppromrlate pupil 
reepooeea to cognitive questions asked. For Instance » If you ask aa Infer- 
ence qoeatlon, sismrl^ «as:pect to obt»ln an Inferential response froe; the 
ptipil. Matrix 2 pr^ldea feedback which Indicates your efficiency In obtain- 
ing appropriate responses or Mtches to your queatlone. 

In eataalnlng Katxlx 2, the aost laportant feature to note la the diagonal 
as Indicated by segment E. This diagonal will abovr ymi the nueiber of **appro** 
prlate Batches" made. An '^appropriate natch*' occura each tijie you ask eny 
queatlon In the TPQR hierarchy and the pupil reepoods at the n— e lerel. 
The laeibers in segment D gl^.^ you the Inatancea by cognitive level when Ae 
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pupU'a reci;>onS€ to a teacher question nae at a higher cognitive le?el in 
th« TPQR ayatca thp.n the question &8ksd» For sxanple. If you ask a scquenclcg- 
paraphraslx2g question and the pupil reaponda with an InferentlAl reapoasa;> then 
an Inappropriate response vlll occur in segment D. 

Siailurly, the nunbers ir segaent 7 give you the instances by cognitive 
level vhcn the pupil response to a teacher question 'WRe at a lower cognitive 
level in the TPQR system than the question asked. For eocample. If you ask an 
inferential question and the pupil responds w^.th & recall response, then an 
inappropriatft response will occur in aegaent F. 

(16) Total Teacher Questions - Pupil Responses * D -4- g 4- F ^ In Matrix 2 
that lA- the Crand Total of Teacher Questions and Pupil Responses which 
occarrad daring the lesron. 

CL7) Percent Appropriate Matches * The total nuaber of appropriate matches 

E 

divided by the total Teacher Question - Pupil Responses «> D + E 4 F. 

? 

(18) yercent Questions higher than Response • D + B F, 

D 

(19) Percent Qwastlons lower than Response - D + E + F* 

(20) TP(y Interaction Sequence guaaary 

At the beginning of aach lesson* you are erp^ted to start asking 
cfuestloos beginning at the discrlnination level and systeaatically continue 
up the TPqpt question hierarchy as indicated in (lA) • 

If you asked a question at any of the six cognitive levels and the pupil 
responded appropriately at that level, then a new line on the printout vould 
have bagiia. (Mote! Bach line on the printout is called a string.) When 
you obtala an appropriate response at any level yoo shoold then ask a question 
at the next higher cognitive level. If the pupil fells to give the appropriate 
reeponae to your question, ask another question at the ease cognitive level. 
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BovQver» do not ask aore than 3; questions In a rov at the saxte cognitive 
level If no appropriate pupil response la given. Note, If no appropriate 
pupil response Is given after 3 consecutive que8t:lons are asked at a particu- 
lar cognitive level, the printer on the printout vlH temlnata the string axvl 
a ncir line will begin on the printout. If you reach the problet solving level 
In the hierarchy and obtain an appropriate response, you should start a nev 
pattern of questlonnlng by beginning at the dlscrlBlnatlon level again. 

(21) Mean String - total nmber of behaviors (cedes) /total ntoaber of atrlngs 
(sea •). 

(22) Median atrlxg 

(23) Standard Davlatlon of String 

(24) Wcabar of Strlx^s 

(25) Huaber of Coapletad SeQuences - nuabar of tines that you have success- 
fully coapleted the sequence froea dlscrinlnatlon to problem solving. 

(26) Percent Cosipleted Sequences - Nuiber of conpleted sequences divided 
by nuabcr of strings (#25/#24). 

(27) Hoaber of codes • total number of behaviors 

(28) Interaction String list - the cocaplete list of all behaviors In the 
lesson In chronological order. T*I, ?^2. 5-0 Indicates a no response vas 
given to the prior (not shovn) teacher question. Refer back to the TPQR 
Observation System (Page 3 - Module 2) . 
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Graphical Analysis of CATTS - Printout 

Each tutor will b€ glvaa a tzmph of hta baMllae behavior (without 
faadback) for approxlmtaly tta laaaona. Thaaa graphs (sac Exaropla -) 
will ba lika jrj^^hs of tha parcant hl?h-lavel teacher questions (labeled 
ratio 2) aol tha percent -hlfh level pupil response, (labeled ratio I). 
The x«coardiuAta as ahovn Is th9 aessloo ouiriier (sessions are lo chronology 
leal order) and the y-coordlnata la percent. 

lacb tutcr will rfigraph the Infovraetlon oo che provided graph paper, 
lo addltlo:!, a.'tar eac*« lesson^ the tutor will graph the sane ratios as they 
appear oo thf^.Lr priarout sbenics as ouctHirs 13 and 14 (see CATTS - printout 
key for further fxplanwtion)- Please Indicate R^^ by a solid line axxl 
by a dotted line, so tbsr the grsphs My Ue easily compared. 

Ideally, a^ wnd J?^ should be spproxieataly psroillcl. Please do not 
graph any iessoo l\iat hM fever than 10 queer lens. 
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CATTS TPOR Coding Record 
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D\T3S COOIKC RECO?» 



SOOYK «0 



DATE 



LESSOS BO . 
TOTCX 

CODQt BOr. 

TIMB 

rSEDBACX 

sn 

LESSOR HD. 
TUTOR BO. 
HTPIL SO. 
CODSK HO. 
TIMS 
FEEDBACK 
SEH 



LESSON NO, 
TOTOR HOo 
POPIL HOo 
CODER R0» 
TIME 
FEEDBACK 
SEN 



■'.I.' 10/. 

9<r -: 



•nrfop 



BOX ootm 



PUPIL _ 

4 

BOX DOWN 

84. 
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Lesson 
Number 



Coder 
Number 



1 



8 



A 



A 



1 2 3 4 5 6 7 8 9 10 11 12 



FEEDBACK CODES 

tl - Ba,seline * 

fl2 - Video 5 Printout 

03 - Scope 5 Printout 

ffi - Supervisor & Printout 



V 



V 




Tutor 
Number 



Student 
Number 



Feedback 
Code 




APPENDIX N 

Objective Evaluation of Lesson Interaction on Other Criteria 
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OBJECTIVB BVALUATION OF LJSSSON INTEIWCTION 
OR OTKSR CRITBRIA* 

*(B«0«d on lialping Hon^xprGgaive chliaren In the Clsasrooa. 
A Self Instructlontl Module by J. Everton b W. Lynch, CITH.) 



gUBOMTIOy 

Any child talk other then rfeding la to be recorded in thie 
obeervetion rfyfitea. The cetogbriae of this eystem nre: 

1. One Word Uttertnoee ' 

3^ Sentence Pregwenta 

i. Slvple Stateventa 

4. Conpound Statevente af "strlnga' 
'/ Complex Statenanta 

6. Yea. No, Ok . . . 

7. I Don't Know, I Can't, No Reaponae ... 

8. ^Habitual Responding 

l> aH3 TOPjO urrKRAKCEB (excluding articles) 

ex. 1 T: Whot vaa the hero 'a naa%7 
P: Michael. 

ejr. 2 T: Why doea this begin prlth a capital letter? 
P: A naiee. 

2- SEWTBICB FRACiiBNTS Thla category describee a response th»t la nore 

than one wor4|, but not a complete sentence. 

ex. 1 T: What patt of the etory did you like best? 

P: When they vere In the rain, 

ex. 3 Tz Explain what evaporation ia. 

P:. i*He» you heat water to boiU 

3- 8IHPLE STATaiENTS A simple atatemeht or aentenco is s coaplete 

.thought. It is almple in the aenae that it ssr.orts b single idea: 
a fact, a definitkon. a rule, an. expression of opinion or feeling. 
It contalna no conditlona or qualifications— no "1/ , "because'', 
but , when , of other aodlfying clause/ (£verton & Lynch, 1976) 

ex, 1 T: Whot pert of the at^ory did you like best? 

P: I liked the part ebout the rain, 

ex. 2 T: Why ia thla nuaber wrong? 

P: You put the decimal on the wrong &lde.* 

♦H.B. A ai»ple sentence can contain ndverMsl phraaea. 
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4. OPiCPOUWD STATaama OR /"STRjjj^^ Homtl expreflaion gen«r»ny 

InvolvM axtanilve^flc of cciipound cliuseti connected in "fitrlnge." 
This lo otuir«ct«rlBtlc of children who are wotivatod, and who Ymy 
••versl things thsv want to asntloa, as in rstelling a story: 

. . snd th«n lis . , . avid than they (Bverton k Lynch» 

1976) 

•X, 1 T: What hsp{»«n«d In this Story? 

P: Everyone got pti the bus and the bee got on and then 

oft wont the horse and pif wsnt the dog . • . 
ex. 2 T: Why is that a better way to 6o problem 6? 

You write down the answer to the first part and then 

you won't forget it. 

5, OOHPUiX STATttRrrs These are the aos^ conplex and woftt mature fores 

of oral expression. They are aoat eaaily recognl/ed by the presence 
of dependent clauses that follow the awin clause (or soaetiMea pre- 
cede it.) 

Goaiplex aeotencea caw be detected by key words (con Junctions) that 
fre()uently aignal a dependent clause: because, since, unless, ex-* 
c^pt, if, while. 

Uiee frequently children use adverbial or adjectlvnl clauaes to 
»odify the aain clause of their sentences, elgnatlsd by such words 
ss: whenever, wherever, when, who, which. 

Coaiplex sentences can be distinguished free coaipound sentences by 
the fact thst there is s wore coaplex thought represented in the 
utterance--*s qusliflcetion, asodiflcjf tion, or relationship^-rather 
than Just several idw^as linked t&getfier. (Everton L Lynchi 1973) 

ex. 1 T: What happened next in the story? 

P: When thi children didn*t know which rond to tske, they 
went up to the old fsnihouse to ask. 
ex, 2 T: flow do you feel ;;hen soneone tells on you? 

P: It really Bwkea ne sad, especially when it*s soaeone 
who^s slways doin* hnd things hlnaolf . 

fi- YM> yO> OK . . > 

7i I DON'T Know, I CAK'T, WO RBSPOOTK 

8. HABITUAL RIgPOjWDIHO The responses belonging in this cstegory include 
sounding out words » child tslk to self, repetition of teacher talk 
sod rfttuelix^ responds thst are learned or nenorlred. 

ex. 1 T: How does ^ long vowel sound? 

Pt It soys its own nsM, 

ex. 2 T: Do you know any rhyses? 

Pi Mary had a little lasib .... 

ex. 3 T: Whst does *V say? Pot the two sounds together. 

P: ''T - ST - «0P" 
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n U 0l»o iMOMaary to lotov »t wjirt point lo tho lessen tho child's 
it>«Bpoits«s in tb«o« various o«t«sorl0a occur. Tborofore, th« lesion 
IB dlvidad Into thr«« ••otions: 

1. OROAWIZATIOWAL Thl« U wh»n tb9 losson is being set up. Th« 
teachar and child are nattlng organiaad. These ar« iraquantly 
procadural itaaa. 

•X. 1 T: Hov ir^ you todty? Are you ready to retd a story? 

PJ Todoy'i my MrtM«y. I brought a cake to achool. 
•X. 2 P: 1 forgot my {wncil. 

T,* H0r<'« 0 pencil New lefe aee whnt we have for 

today. (The teachei: Is moving into the body of the 
leseoQ.) 

2. Km Thle includes teacher •otivational techniques, setting 
the tone of the Idsson, explsnationa of what will be done, the 
leason itself, and post-leaaon questions and tnlk on the sub- 
ject Bistter. • 

ex. 1 T: Testerdsy, you went to the roo. whnt did you see 
there? 

P; Vfe sav iK^nkeys^ and seals that at© fish tnm us. 
ex. a T: These words are io our story. How many do you know? 
P: Ssnd, plsy, sesshor« .... 

3. CLEAi^— UP This category includes sny talk responses that 
occur Jfter the body of the lesson is over. AgRin nost. items 
here ere procedural. Soaetimes there are value questions in 
this section. The teacher and pupil are getting ready to leave« 

ex. X T: You r«ad that story well. Hew you can read it to 
your little^ brother. 
P5 Can 1 csrry'the books and pencil back? 



ex. 2 T: What would you like to do next time? 
P: I want to ploy ;s csise next time! 
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ELABORATION 

P\xl ^5 chocfe In the proper ceteg^ory for oil child talk other ttsn 



ORCANi:;LVrj^iIAL lesson IK)DY CLT-AU-UP 



1 0^1 Tl^RO 
UTTKRANC5S 




. _ . 












FRAGMENTS 
















3 SIfiGPLB 

STATSMSNTS. 
















CC7JP0UHD 

OR "STiliNGS" 
















9 OOilPLKX 

STATKHENTS 
















X J>o , flu, Ulw • t • 

(SPOCTANEOUS SPEECH) 
















I DON'T KNOW 
7 I OAM'T 

KO RSSFOHSB ... 
















0 HABITUAL 
RS3P0NDIKG 
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Tutor Schedule 
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r<>TOIl SCHEDHILE ■ KA95 SPRING 19>6 



Tuesday 


A 


a 


C 


8t45-9:15 


{Dona 03) video 


McKlroyl4 
(Carla 06) scope 


Seifert«20 
(Jan 02) super 


9:15-9:A5 


Maggl-13 

(Mark 05) super 


Gaughan-07 
(Alice 09) scope 


Zettlemeier-22 
(Kefth 11) vldei 


9:45 10:15 


Pawl Ik- 17 
(San 01) vidao 


Gross-lO 

(Richard 07) scope 


Rogers- 18 
(Jim 10) super 


10:15-10:45 


Ga 1 itig iy*uo 
(Terry 04) auper 


Lonniui ler- i^c 
(Mark 05) scope 


P Ji 1 mm V* • 1 A 

(Mellnda 08) video 


10:45-11:15 


Newhouae -1!; 
(Terry 04) vivieo 


Conklin -03 
(Keith 11) scope 


Bailey-01 
(Alice 09) 


11:15-11:45 


Gould-09 

(Sara 01) super 


BieritE-02 
(Richard 07) scope 


Feinsteraiaker-05 
(Jim 10) video 


Thuriday 








11:00-11:30 


Pe f na terraaker-05 
(Jim 10) video 


Bierltis-02 
(Richard 07) scope 


Gould-09 

(Sam 01) super 


11:30-12:00 


Pelkel-04 
(Dona 03) auper 


Strout8-21 
(Jan 02) scope 


Koday-11 

(Melinda 08) video 


Friday 








( 8:45-9:15 


\jc nil/ ^ L vi o 

(Dona 03) video 


McElrov-14 
(Carla 06) scope 


Koday-11 

(Melinda 08) video 


9:15-9:45 


Maffff 1-13 

(Mark 05) auper 


Gaughan-07 
(Alice 09) scope 


i;ettlemeier-22 
(Keith 11) video 


9:45-10:15 


Palmer-16 

(Mellnda 08) video 


Strouts-21 
(Jan 02) scope 


Gaiogly-06 
(Terry 04) super 


10:15-10-.45 


Selfert-20 
(Jan 02) super 


Lohmuller-li 
(hark 05) scope 


Nevrhouse-li 
(Terry 04) video 


10:45-11:15 


Pawlik-17 
(Sam 01) video 


Gross-10 

(Richard 07) scope 


' Bailey-01 
(Alice 09) 


11:15-11:45 


Fe Ike 1-04 
(Dona 03) super 


Conklin-jd3 
(Keith 11) scope 


Rogers- 18 
(Jim 10) super 
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